Well, until they've experienced first hand what those things are all about, I would say.no one wants to strap these things to their face...
As an owner of both a PlayStation VR and a HTC Vive, I think the main hurdle is the high amount of money you have to put in order to buy the devices. 800 dollars/euros are quite a steep price for something you are not sure you will be frequently using.
Some VR experiences are also nausea-inducing, which doesn't help at all. But I would say that as soon as people discover how great flying can be, they will be just asking the market for better wings.
I believe this is a great opportunity for Apple. Not sure the current management has what it takes to take it, though.