Apple Looking to Create an 'Entirely New Application Paradigm' for AR and VR

[tennisproha]

Wish Apple would push itself outside the box when it comes to bug fixes. Seriously, it’s ridiculous that basic things still don’t work correctly

 

[Le0M]

Tiny video cameras on the device (imo, glasses) the user wears. And perhaps a microphone or two.

So, no hands/arms gestures? I actually hope we'll be interacting with AR/VR with hands. Not by blinking once or twice for left and right click respectively ?.
For me, it's obvious we'll use hands to interact and the cameras will track eyes movements etc. I'm just not sure HOW. I.e: are we gonna have to wear gloves? Or other kinds of hand-held devices?

 

[sideshowuniqueuser]

AR is where it is at.
Walk into a store. Look at items on the shelves. Eye tracking knows what you are looking at. HUD displays the price of the product, how often you buy the product. If you buy the product often and have run out at home, a reminder might pop up and indicate how many items would be worth purchasing (based on your purchase history).

You pick up a pack of biscuits, instantly the ingredients list pops up (no more impossibly small ingredients lists on packages).
If you are someone with allergies it can warn you if their are ingreients that might cause you a problem. Perhaps even indicate a similar item that does not have something you are allergic to.

As you scan the isles looking for something, the system notices you are searching - prompting you to indicate what you are looking for. You say 'cheese', and a pop up on the display shows 'isle 14' with an arrow indicating the direction to head in.

All pricing labels, paper notices, stickers etc will all dissappear.
As a store owner - when there is need to change the price of something - change it in the system and you are done. No meed to update signs or anything - customers see the new proce via their AR immediately.
Add a new product to shelves, same story.

Repairing something - HUD shows which screws to remove next, their type and size by highlighting them on the item you are looking at using AR. Complete a step and it shows you the next step.
Diagnosing a hardware problem, status shows on the HUD.

It goes on and on, and it is all AR. VR might be 'cool' or useful in training, but I really think AR is where it is at.

The biggest issue is to have a data interchange format that all AR devices support, image recognition that works, and the ability for people to easily create AR resources such as a repair guide for a peice of hardware, or a map of a store and where items are on shelves. The likelyhood that AR itself could be used as a tool for inputting this data in the first place is immesly high. Walk around your store amd it creats a map, look at shelves and it picks up on products and where they are located. No need to type all this data in, making it easy for people to start using in the first place.

Wow, those are some pretty cool use cases. Thanks for that.

 

[sideshowuniqueuser]

We all know how buggy iOS and Mac os is currently.

World class hardware with just working level software!
Hardware is ready & only few months left for launch and now they’re focusing on software.

Very good point. I really don't understand why the entire software division management team hasn't been fired long ago. They must either have something to blackmail Timmy with, or the division head is Timmy's secret bf. These are the only possible explainations I can think of.

 

[throAU]

Tiny video cameras on the device (imo, glasses) the user wears. And perhaps a microphone or two.

The quest 2 and HoloLens can both do full hand tracking, I would fully expect apple to do the same.

The HoloLens also does eye tracking.

 

[svish]

With Apple about to launch AR/VR device and Apple's emphasis on AR with LiDAR on iPhone/iPad, this can come true.