@aniron Right, it depends where the probe ends up relative to the magnet. In the worst places, it was reporting "lumps" of up to about one millimeter. I finally figured out what was going on when the magnetic sheet was pulled off to see where the probe was, and it was right over one magnet when reporting the worst problem. After being replaced with a BLTouch, the "uneven" bed became really flat.
Like you said though, as long as the probe is kept away from magnets, it'll avoid the worst of the problems, so it's probably fine then.