That's the gatekeeper, right? I hate with all my heart.
Apparently, the only real way to test it (according to Apple support) is to try it on a fresh VM each time.