The M1 Macs use Apple's own implementation of Thunderbolt and that could be the cause. If so, maybe they will fix it in the M2 - but in this case, I now have a $5,000 paperweight and need to fork over cash for a M2 laptop ...
I really, really nobody is silly enough to do that, but I suspect they will be. Things kinda worked under Monterey, but worked far, far more poorly under the hyper-buggy, awful Ventura.
This should tell everyone that it is a pure software issue and being bullied/misled into buying a new computer is borderline fraudulent behaviour.
It's just a question of Apple's incompetent software developers making very buggy, poor drivers for the M1 in Monterey, and then somehow, astonishingly, managing to make it even worse under Ventura. For Intel chipsets, base drivers were most likely supplied by Intel themselves (chipset vendors usually provide such things) but the quality of vendor drivers is often poor; Apple may have replaced or debugged them, perhaps, but there are years of Intel chipsets to examine for history and to see all the places where numerous USB device quirks were accounted for.
This is Apple's fault, it's Apple's software, don't buy a new computer EVER for that - complain to Apple until they fix their broken product - or it's not fit for purpose / if you went from Monterey to Ventura, then they broke your computer - either way they should refund you (sucks if your country has weak consumer laws that don't allow that though).