Might worth reporting here. I finally got HomePod minis work as my Mac speaker without of any lag in any applications!!!
I happen to use a TV with eARC support (LG C2 42) as my main monitor for my Mac, and I'm having an Apple TV 4k sit on my desk for over a year.
Since apple releases the eARC support for Apple TV, I'm able to add my HomePods as the default speakers and passing all audio from my TV through ATV.
This works smoothly without any noticeable lag, movies, YouTube, zoom, etc. Everything works!
Give it a go if you have similar setup.