Got a tip for us?
Let us know
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
Developers Share First Augmented Reality Creations Using Apple's ARKit
- Thread starter MacRumors
- Start date
- Sort by reaction score
It's always a mistake to bet against Apple and incorrectly assume they are "years" behind the competition. Clearly Wall St. doesn't get what Apple just did. Every museum, store, travel agency, furniture manufacturer can easily take advantage of this api.
Apple is using all of the iDevice's sensors to keep track of where the iDevice's camera is in the world space of the AR model. I don't think it's a RAM issue, as you're just taking sensor inputs, then directing the scene's camera to replicate the iDevice's position in AR space.
I don't think you get it. AR has existed on iOS for years too, since 2010 at least. There are quite a few AR apps on the App Store already as well. What ARKit does is give developers access to new frameworks making developing these apps a lot easier and more powerful than the ones are currently possible.
But of course you knew that already and you're just trolling, so carry on.
Sorry TallMan. I gotta nit pick your comment a little bit. If you're discussing the pros and cons of the current AR environment and tech, please do not bring VR into the conversation. It unnecessarily confuses and dilutes the point you're trying to make. AR and VR are not similar and do not share similar arguments. All of the arguments you presented for Apple's ARKit being better than current offerings... they're all wrong. They are arguments about VR - virtual reality, not AR -
Here is an example of AR hardware. When thinking of AR, think more Google Smart Glass and less Oculus Rift.
Last edited:
This just isn't a relevant comment anymore. Things are not "good, for mobile" anymore. These things are BEST on mobile. There is no "better" platform.
IKEA's app is nothing compared to this ARKit.
IKEA uses printed markers, like the catalog or furniture assembly instructions, placed flat somewhere in the field of view.
Without markers it can handle only rotations using the inertial sensors, but not translations.
So in the IKEA app, if you have no printed markers, you have to stay in one spot and you can only look around. It doesn't do any computer vision. It only uses the gyroscope and the accelerometer to figure out which way you are looking.
ARKit doesn't need any markers and it uses serious computer vision and the inertial sensors to figure out which way you are looking and how you are moving. So you can just start it up in your room, walk around, look around, and it will display all the AR overlays in their right place.
This is a whole different class of technology.
Previously you needed special depth sensors to do this, like Microsoft's Kinect and Hololens, or Google's Project Tango.
I couldn't believe how awesome this was at WWDC. I know many are unimpressed, but I was trying to explain to my kids when I showed them the game on the table how far tech has come even in the last decade. And I see so much potential for multiplayer gaming in living rooms around the coffee table, just seems like so much fun.
I just don't get this technology. Isn't this the whole issue that google glasses had but even worse. Ie. Other than in the medical and industrial fields etc which regular consumer would want to hold up a phone in front of their face or worse a big iPad for long periods of time to 'enter another world'. It's awkward to hold and uncomfortable. Old people won't be able to. Are people going to want to wear goggles all the time. Only if Apple turn it into a fashion eye wear accessory. That's super comfortable to wear will this take off.
The tech has to start somewhere. See VR. Massively more CPU and GPU intensive than “2d” graphics would be rendering the same scene on a monitor. The important thing is to establish the tech and API and the graphics can grow along with new GPUs. If Apple can do with custom GPUs what they’ve done with their CPUs it’s going to be scary...
One of my companies has been engaged in AR/VR work for a few years, I was working with a team developing SLAM libraries for this very thing, localizing objects while moving, and maintaining their spatial context, neat stuff, not all that memory intensive (depending on how models are managed, etc.). You should see Holo Lense (inside-out tracking), you can dump dozens of 3D objects/models all around a large workspace, roam around, jump from around corners, everything is perfectly tracked and stable.
Yeah, it's about easy developer adoption, new use cases that create consumer visibility, that seems way more viable with ARKit (and the consumer base of iOS devices).
I can't wait to check it out, just neck deep in some other (non-xR related) work
Didn't you see the Wingnut demo? There will be millions of people wanting to use games like that. And it is actually a feature that it doesn't require special hardware. If your app requires a ridiculous special hardware, that's indeed a flaw. And boy, are VR goggles ridiculous?
Until someone makes AR glasses that are lighter, smarter, inconspicuous, fashionable, and not completely ridiculous, this is the best you can get.
Unless I'm mistaken, for now, ARKit is going to be limited to just apps you download from the App Store. Since Apple doesn't allow porn in the app store, that's not going to happen. Jailbreak interest might spike increase as AR Porn apps leveraging ARKit can work there.
Alternatively, Apple could allow ARKit to be used within web apps in Mobile Safari, where pages can serve up whatever they want and Apple has no control...
Yeah... I can see Apple allowing that. Couple it with Apple Pay on the web and Apple could be making a nice profit off of AR Porn without actually allowing it on the app store.
(I like how quickly this thread about amazing new technology went to "How can we use this for porn?")
That's the key there: It has been done before, but with special hardware. It's easy to do 3D SLAM with a depth sensor, like the one in the Kinect or HoloLens. Try doing it without special hardware in a mobile phone. That's when magic happens.
Video game industry revenue is about 3x bigger than porn in U.S. so I don't think Apple cares. Besides most of porn is pirated so Apple would miss out on all of that revenue anyway.
[doublepost=1497448386][/doublepost]
How come none of these demos ever walk fully around the CG character or set? I wanted to see the lighting on the back from that red lamp. I'm sure it wouldn't look real (and maybe that's why they didn't bother) but I want my demo fully interactive. It's the game and story developer's job to make me not want to care about what she looks like from behind and keep my attention focused. But for demos, I want warts and all.
Apple only announced its augmented reality developer platform ARKit last week at the Worldwide Developers Conference, but some video clips have already been posted online by developers eager to showcase the impressive potential of the software.
ARKit enables iPhones and iPads running iOS 11 to superimpose computer-generated graphics over the real world, allowing developers to take their apps beyond the screen and into the user's environment.
Apple ARKit running Unity and Overwatch Widowmaker, by Cody Brown
By using the built-in camera, processors, and motion sensors found in iOS devices, virtual content appears on top of real-world scenes, and users don't need any special equipment to enjoy them because ARKit does the heavy lifting.
One developer who spoke to Motherboard said Apple had improved upon existing AR solutions like Hololens and Google Tango by making the ARKit framework elegant and simple to use.
During its keynote at WWDC, Apple demoed a range of effects that ARKit is capable of. One demo by Wingnut Studios wowed the audience with a tabletop sci-fi raider assault. Another showed a user placing a steaming digital coffee mug and a lamp on a table and moving the objects around to show off the tracking and shadow effects.
Several other ARKit developer demos have since appeared online, including a virtual "iPhone 8", roving StarWars character BB-8, dog-stalking zombies, office floor naval battles, dancing Candy rock stars, and more.
Rainforest garage by 8ninths
Apple has invested heavily in augmented reality in recent years, making several VR/AR company acquisitions including PrimeSense, FaceShift, and Metaio. Apple's much-anticipated "iPhone 8", which is expected to be announced in September, is rumored to have 3D sensing capabilities, with augmented reality being one possible use for the technology.
ARKit will come to compatible devices as part of iOS 11, which Apple is set to release in the fall.
Article Link: Developers Share First Augmented Reality Creations Using Apple's ARKit
Is it some limitation I am not aware of? It looks nice but until we can full walk around the character, it's just 1/2 AR to me.
[doublepost=1497448712][/doublepost]
I don't think it's meant to be used for extended periods of time unless you're into AR gaming. Think of it more as augmented messaging or mapping or whatever app you can think of. On the streets, people don't seem to mind looking at their phones while they walk and even drive. This just places a layer on top of that now so they can get glanceable info and details they couldn't get before based on where they happen to be or look. Not that much different than current phone use.
[doublepost=1497448925][/doublepost]This demo looks good but can anyone tell me if this is real:
Supposedly it was produced using ARKit but the tracking and reflections are truly amazing. It has to be a fake, right?
Just checked out wingnut now. Still completely unconvinced. You're holding up an iPad and viewing through its screen. I get that the objects are tracked in 3D space but it's still not 'real'. It's just an image on your iPad just like watching any movie. maybe if I saw it for real I'd appreciate it more. And Apple can't be that stupid that they would invest so much into something they haven't researched is going to massively take off so of course I reserve judgement. But presently I just don't see the value. Especially through a really small mobile phone screen which the majority of users will be using. Im sure there will be increíble applications that will come out but judging by what I have seen so far it's a dud. Or will take years and years before it brings true entertainment value.niw if that wingnut was a 3D hologram that you didn't need to hold up a screen in front of then yes that's game changer. Until then it's meh
Just a note:
AR = Augmented Reality. As in a view of real life, but with extra items added.
Thanks for the correction. Believe it or not, I actually meant augmented.
I understand your belief that this isn't super useful but think of it like this, three kids around the table. An empty table but each kid has an ipad standing there in front of them. In the middle of the table isn't a monopoly board but a wasteland warzone. Soldiers moving in from each players position. Helis hovering above the table. Airstrikes coming in from the other side of the room.
This is the first generation of ARkit. Next time you drop an apple of the table and now its a mountain in the board. Put your hands there to wipe away soldiers like a hand of god. New Popolus game..
A few iterations later and you have this HD view right in front of you from you Apple vision goggles. Light enough to be used all day.
Maybe there's more applications than video games? Just a hunch.
