MacRumors

macrumors bot
Original poster
Apr 12, 2001
53,574
15,270



With iOS 11, Apple is delving into augmented reality in a big way, introducing an ARKit development platform that will allow developers to quickly and easily build augmented reality experiences into their apps and games.

ARKit is positioned to be the largest AR platform in the world when it launches this fall, using the camera, processors, and motion sensors in the iPhone and iPad to create some incredibly impressive augmented reality interactions.

While we won't see the first augmented reality apps and games built on ARKit for a couple of months, Apple has an ARKit demo app to show off what ARKit can do. We went hands-on with the demo to give MacRumors readers just a small taste of what to expect.


ARKit uses technology called Visual Inertial Odometry to track the world around an iPad or iPhone, allowing a device to sense how it moves in a room. ARKit automatically analyzes a room's layout, detecting horizontal planes like tables and floors, which then allows virtual objects to be placed upon those surfaces.

With ARKit able to place any virtual object within a physical room, developers can create all kinds of unique experiences, and developers have already released several demos showing what might be possible.

Apple already has at least one major retailer on board to use ARKit -- IKEA. IKEA is developing a new augmented reality app built on ARKit that will let customers preview IKEA products in their own homes before making a purchase. IKEA has offered augmented reality functionality for a few years now, but the company says Apple's new platform will much improve the experience. With ARKit available, IKEA says augmented reality will now "play a key role" in new product lines.

For additional details on other developer tools and features coming in iOS 11, make sure to check out our full iOS 11 roundup.

Article Link: Hands-On With Apple's 'ARKit' Augmented Reality Demo for Developers
 

mi7chy

macrumors G3
Oct 24, 2014
8,242
8,941
DRAM is going to limit the number and complexity of objects loaded along with a newer GPU required for decent performance. I can see needing the 2017 iPad Pros with 4GB DRAM and GPUs to have a positive experience.
 
Last edited:

X38

macrumors 6502
Jul 11, 2007
472
314
It's one of these technologies where you just know there will amazing use cases and applications all over the place, but it's pretty hard to imagine many specific examples.

It certainly looks intriguing. One thought that comes to mind is that it might be pretty interesting if there were some sort of ARKit 'server' function for sharing AR worlds such that different users could simultaneously see and interact with the same AR world from different perspectives on different devices. (Please forgive my ignorance if it is already known to have such a capability.)
 
  • Like
Reactions: 4RUNRCLB

FactVsOpinion

macrumors 6502
Jul 27, 2012
316
506
If the camera could track a tool, or even your hand, such that you could interact with virtual objects that way, that would be neat.

That is, pick up the cup, turn the cup, or push it off the table
 
  • Like
Reactions: X38

Superhappytree

macrumors 6502a
Sep 10, 2015
864
2,801
Cumbria
DRAM is going to limit the number and complexity of objects loaded along with a newer GPU required for decent performance. I can see needing the 2017 iPad Pros with 4GB DRAM and GPUs to have a positive experience.

Isn't Apple making their own custom GPU's for the iPhone 8 though? Maybe that's just powerful enough? And maybe they'll up the RAM to 4GB like the new iPad, you never know. This would be a good excuse for it. I don't know if the former is correct though so apologies if it isn't.
 
Last edited:

pat500000

Suspended
Jun 3, 2015
8,523
7,514
I could possibly use this tech for building design or city planning or whatever like sim city game. If i was house burglar, i could use what-if scenario with this ar/vr tech.
 

MatthewAro

macrumors newbie
Sep 21, 2016
1
0
Atlanta, GA
I tried running it on my iPhone 6 but it said my devoice was not supported :(
[doublepost=1498003044][/doublepost]
Does anyone know how to get this demo? Is it on the developer portal? I can't seem to find it.
It is in the documentation section of the ARKit Dev Page
 

Nevaborn

macrumors 65816
Aug 30, 2013
1,078
312
AR was always the dream. I knew Apple would nail it. From game interaction to customising home design and using the camera to view and find out information about the world around you.AR really is the next step in technology. VR has its place for games and entertainment but AR is a tool for every day life.
 

Jared Strike

macrumors 6502
Aug 10, 2013
261
207
Can't wait for integration in maps. Being a tourist will never be the same.
That will be amazing!

Hell, once the 3D rendering and imager gets better in the next few years, the attraction will come to you! Want to go to the Taj Mahal? No need to go to India, just walk outside. Want to go to Yosemite? Walk outside your doorstep, just to mention a couple examples.
 

4RUNRCLB

macrumors member
Nov 3, 2016
42
19
Phoenix
I tried running it on my iPhone 6 but it said my devoice was not supported :(
[doublepost=1498003044][/doublepost]
It is in the documentation section of the ARKit Dev Page

To quote Darth Vader: Nooooooo!!! I may finally have to ditch my iPhone 6 at some point if this really takes off, but that's not going to be the end of the world. First world problems. Right?
 

4RUNRCLB

macrumors member
Nov 3, 2016
42
19
Phoenix
Honestly this looks pretty cool. I can see this really taking off in the gaming realm. It's really life VR without the bulky headset. I would really like to know what else people can come up with down the road to use this in ways other than gaming, but then again that's why I'm not a developer I guess
[doublepost=1498010852][/doublepost]
The technology is cool, but nothing practical that convinces me to spend $800 on a head set.

I think the point with is that you don't need a headset, just your phone/ iPad... Correct me if I'm wrong though.
[doublepost=1498010961][/doublepost]
Can't wait for integration in maps. Being a tourist will never be the same.

Very good idea. Even walking around you own city/ hiking would be fun if there were apps that laid out trails or info about the places around you.
 

sudo1996

Suspended
Aug 21, 2015
1,496
1,182
Berkeley, CA, USA
I'll bet this is going to be a lot easier than what I tried doing with OpenCV. And most of the effort there was just linking the library into a Swift iOS app. Had to bridge from C++ to ObjectiveC++ to Swift. Nightmare.
 

mark-vdw

macrumors regular
Jan 20, 2013
132
169
I have the Mattel VR headset. Be nice to see the merger of AR and VR on such devices. "aVR"
Can any dev with access to the ARKit API confirm whther it's written in a way that easily translates from the 2D iOS screens to stereoscopic goggles?
 
  • Like
Reactions: JosephAW
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.