I had this idea over a decade ago, before AR or VR were really viable things with existing technology, but the idea was that you point your phone camera at physical objects and then use your finger to "write" on those objects, and your phone would detect your finger "writing," and would virtually overlay your written text onto real objects. So when you point the camera at those objects later, you'd see the note. Example would be you write out a list of ingredients on your fridge as a list of what things you need to buy from the store.
Of course, that was not only not technologically feasible, but not very practical (why write virtual notes you have to scan with your phone vs just putting them on your phone or physically on your fridge).
But it's the way the Vision Pro works, it allows you to pin windows in physical space. And maybe that ability itself renders my idea pointless…but I wonder if you could easily do something like use an Apple Pencil (recognized by visionOS) to write on physical surfaces in handwriting style floating pinned text, and eventually (when the Vision Pro becomes something that fits in a normal size glasses form factor and/or when battery life is a lot better) it's something that actually makes sense to use regularly.
Of course, that was not only not technologically feasible, but not very practical (why write virtual notes you have to scan with your phone vs just putting them on your phone or physically on your fridge).
But it's the way the Vision Pro works, it allows you to pin windows in physical space. And maybe that ability itself renders my idea pointless…but I wonder if you could easily do something like use an Apple Pencil (recognized by visionOS) to write on physical surfaces in handwriting style floating pinned text, and eventually (when the Vision Pro becomes something that fits in a normal size glasses form factor and/or when battery life is a lot better) it's something that actually makes sense to use regularly.
