I don't think that's true. I think the headset needs to come in below $1K before the average user buys in (a game-changing use case notwithstanding). $2K is a lot of money. $3K is a lot a lot of money. Apple has a built-in hardcore fan customer base who will buy this product at whatever price. But, once all of those are sold, I think the headset will be a pretty tough sell at a higher price point. I doubt the Watch would be selling well if it were priced at $2K.
Apple doesn't just sell consumer products. They also find ways to justify making products that they just think should exist (as long as they don't lose money on them).
The rumor mill are the ones who think Apple will try pitching a $3k headset to the same people who are on a four year phone upgrade cycle. That is because they don't see a way it could work, but they'd LOVE to see Apple pull that off.
A $3k headset is targeting the same audience as the Pro Display XDR - people who need the features or have disposable income.
Likewise, the story is that Apple has some five year plan to turn this into some broadly accepted, iPhone (or at least Watch) level consumer product success. But thats all speculation. They could be working on a port of Fitness+. Also, they could be trying to sell this as a product that could be used to perform remote medical procedures. We won't know until tomorrow.