The last time this issue bit me (the resulting post you linked to) was for a game called Pathfinder: Wrath of the Righteous. It is a top down RPG by an indie developer and I confirmed that it was not 'notarized' by Apple in SteamDB. The other game I was trying to install was Baldur's Gate 3, and it also does not have the "macosnotarized" designation in SteamDB. I had been encountering difficulties installing on not only on my Intel iMac from 2017, but also an M3 MacBook Pro. You are correct that the verification process was quicker on the Apple Silicon Mac, but it was still odiously long (~30 minutes.)
Other possible complications: installing the game to an external drive or a non-APFS filesystem. And indeed I finally did have to delete several gigs worth of other games and install to my internal SSD to get the game to install in under an hour on the MacBook Pro. That simply wasn't an option on the Intel iMac due to an even smaller internal SSD.
Like you I also do not run into the issue when installing a Windows game via Crossover, or in a virtual machine. Gatekeeper only seems to scan native Intel Mac or Apple Silicon games.
But honestly I don't give a gnat's fart if it was notarized by Apple, the developer or Mickey Mouse. These kind of complications simply do not exist on other platforms, and Apple customers should not have to put up with such an obnoxious install process.
That said your testimonial about not having to wait more than a few seconds or minutes is puzzling to me. But the lack of many other Mac users complaining tends to support that experience. I'm open to the possibility that both of my Macs have some odd configuration issue, though that does seem unlikely to me. This is an issue I've been having with Gatekeeper for years and my patience is running very thin.
If it is of any help, this is the dialog that pops up on my Mac during the verification process.
View attachment 2396147
And no, I'm not exaggerating when I say that it stays there for hours on the iMac, and half an hour on the M3 MacBook Pro.