Dirt stains become little magnets once inserted into the big magnet and severely distorts the magnetic field homogeneity, and such distortions cannot be fixed by topshim or manual shimming. See the spectra below.

Red: Before wiping.

Blue: After wiping with KimWipe(r).