Xcode 11 GM Confirms Apple's Work on AR Headset

[mdriftmeyer]

A framework does NOT need to be included in a GM software release for a press event announcing hardware that will ship later (even if the hardware was announced).

If they have a closed loop test of preferred top tier developers who have been given hardware to test, they might as well keep the framework in there instead of building custom builds of XCode specific to just these developers.

I know from experience as I used to co-oversee the Prereleases at NeXT and we carried it over to Apple before later moving a non hard media deliver to developers.

 

[Abazigal]

This is a massive leak that keeps getting worse. And it's pretty mature.

Very surprising that Apple didn't announce it today, it really seemed like they intended to.

It’s possible this AR headset might be announced in a separate keynote next month. Today was really all about the iPhone, and Apple wouldn’t want a new product reveal stealing all the attention away.

Though my guess is a 2020 reveal. This way, you have two generations of iPhones that will support it processor wise, thus improving adoption rates.

 

[anthogag]

I am hoping these glasses can also be an external ‘screen’ for the iPhone.

 

[aksala]

It is a common sentiment I hear on these boards, but I disagree that smartphones innovation has “plateaued”.

I think Apple has just gotten too fat and comfortable at the top. Other companies are scrambling to come up with something fresh, but without new Apple features to copy, most are lost.

I think there is plenty of space left to innovate in smartphones, but I also recognize that’s a minority opinion on these boards.

I disagree with your disagreement - I think this is the beginning of the end for the iPhone - and all phones. I believe Apple is going to attempt to kill off the 'phone' as we know it within the next five years, like they have with so many other technologies - floppy disk, cd/dvd-rom, headphone jack, etc). I feel at some point, probably in about 3 to 5 years, they are going to retire the 'iPhone' moniker and call it something entirely new - perhaps some sort of all-in-one iCom device or maybe something as simple as the 'Apple Computer' again (complete 360 from where they started).

Apple likes to kill off complete device categories... it's their way of making a mark on history. I think they'll do it again for the 'phone'. Or at least try to. We'll see.

 

[smulji]

It’s possible this AR headset might be announced in a separate keynote next month. Today was really all about the iPhone, and Apple wouldn’t want a new product reveal stealing all the attention away.

Though my guess is a 2020 reveal. This way, you have two generations of iPhones that will support it processor wise, thus improving adoption rates.

I agree. I see a Spring 2020 reveal, at the earliest. I wouldn't be surprised if the ultrawide band technology in the A13 chip will be a requirement to pair with the AR Glasses.

https://twitter.com/stroughtonsmith/status/1171630061788848128?s=20
[doublepost=1568179363][/doublepost]

I disagree with your disagreement - I think this is the beginning of the end for the iPhone - and all phones. I believe Apple is going to attempt to kill off the 'phone' as we know it within the next five years, like they have with so many other technologies - floppy disk, cd/dvd-rom, headphone jack, etc). I feel at some point, probably in about 3 to 5 years, they are going to retire the 'iPhone' moniker and call it something entirely new - perhaps some sort of all-in-one iCom device or maybe something as simple as the 'Apple Computer' again (complete 360 from where they started).

Apple likes to kill off complete device categories... it's their way of making a mark on history. I think they'll do it again for the 'phone'. Or at least try to. We'll see.

"Apple likes to kill off complete device categories"

If that were generally true, the Mac would have been dead awhile ago. Yet here we are 35 years later and it's still going strong. Surprisingly, even the iPod is selling.

 

[farewelwilliams]

This should have never made it into the GM. More evidence of software development incompetence at Apple.

you try running a team of tens of thousands of engineers.

 

[Cosmosent]

Just my $0.02, but Apple can't afford to take the chances that Google & Facebook have.

Apple's Rep is much more important & valuable to them, than Google's OR Facebook's to them.

As such, I'd say the chances this sees the light of day as an actual product is ONLY 10-20%.

To say Google's version didn't work out for them is a major UNDER-statement !

 

[aksala]

All good points - thanks, all, for commenting.

 

[BuddyTronic]

Fantastic!

 

[Geurt]

Code found in the golden master version of Xcode 11 confirms that Apple is working on an augmented reality headset of some kind, and perhaps planned to announce it at the event but scrapped the debut last minute.

9to5Mac's Guilherme Rambo and developer Steve Troughton-Smith found that Xcode 11 features an ARDisplayDevice framework with references to codenamed Apple headsets that are in development, including Franc, Luck, and Garta (which pertains to HoloKit, a third-party device).

An Apple Glasses mockup​

References to these names were previously discovered in iOS 13 code alongside a STARTester app able to switch in and out of a head-mounted mode, replicating the functionality of an augmented reality headset on an iPhone for testing purposes.

​

​

​

​

​

There was also a reference to a StarBoard system shell for stereo AR-enabled apps, which has also been located in the Xcode 11 GM by developer Steve Troughton-Smith, along with a ReadMe file that specifically references an Apple "HME" headset.

It's not entirely clear what Apple is working on, but as 9to5Mac outlined last week, the stereo augmented reality data found in the iOS 13 and Xcode 11 GM code references support for a face-mounted AR experience said to be more similar to Google's Daydream than a pair of smart glasses.

The fact that Apple left this code in the Xcode 11 GM suggests that it was perhaps something that the company originally planned to talk about today, though it's not known if that is indeed the case.

Article Link: Xcode 11 GM Confirms Apple's Work on AR Headset

Wow, three pages needed to link this AR framework to the new gaming platform that was announced yesterday? I hope

 

[incoherent_1]

I disagree with your disagreement - I think this is the beginning of the end for the iPhone - and all phones. I believe Apple is going to attempt to kill off the 'phone' as we know it within the next five years, like they have with so many other technologies - floppy disk, cd/dvd-rom, headphone jack, etc). I feel at some point, probably in about 3 to 5 years, they are going to retire the 'iPhone' moniker and call it something entirely new - perhaps some sort of all-in-one iCom device or maybe something as simple as the 'Apple Computer' again (complete 360 from where they started).

Apple likes to kill off complete device categories... it's their way of making a mark on history. I think they'll do it again for the 'phone'. Or at least try to. We'll see.

It’s possible! I think it’s unlikely we’ll see the 4-7” rectangle-in-your-pocket device category disappear in my lifetime (whether they call it a phone or something else). It fulfills too many categories to be quickly dispatched — communication, entertainment, navigation, etc.

But I’m also often wrong about these things, so look me up in a couple years when you’re right and I’ll gladly buy you a coke

 

[eulslix]

I disagree with your disagreement - I think this is the beginning of the end for the iPhone - and all phones. I believe Apple is going to attempt to kill off the 'phone' as we know it within the next five years, like they have with so many other technologies - floppy disk, cd/dvd-rom, headphone jack, etc). I feel at some point, probably in about 3 to 5 years, they are going to retire the 'iPhone' moniker and call it something entirely new - perhaps some sort of all-in-one iCom device or maybe something as simple as the 'Apple Computer' again (complete 360 from where they started).

Apple likes to kill off complete device categories... it's their way of making a mark on history. I think they'll do it again for the 'phone'. Or at least try to. We'll see.

I’m almost 100% certain thats not going to happen. Each technology has their own advantages which are very hard to merge. The MacBook and iPad might merge into one device once Apples figures out how to fluently switch between MacOS and iPadOS. With the MacBook switching to ARM processors, I can see this happening within the next 10 years.
Other than that, folding an iPhone into an iPad with at least 12” size, perfectly flat and locked in stable and an integrated keyboard with good haptics... nah, don’t see this happening in the next 10 years, if at all... so these 2 product lines will be separated.

As for the glasses, they again, have their own use. They wont replace the iPhone since the user interaction is very different. Using gaze gestures is way more subtle than anything you do on the phone. Using hand gestures in the air is pretty exhausting, which will be required since the cameras wont see them otherwise. I also don’t see them emulating an iPhone on screen, since that lacks the haptic feedback.

So... You wont be using your glasses for browsing stuff... you still will use your iPhone for that.
The glasses will take a similar spot like the Apple Watch. They will compress the information from the iPhone and merge it with the real world information in front of you. The glasses will add interactions with the real world on top of the whole ecosystem. Complex UI interactions will be done on the iPhone, but reflected on the Apple glasses. It’s pretty much the same interaction pattern as with the Apple Watch.
This approach also offers the advantage of offloading computation and energy requirements into your pocket device, where weight and size don’t matter as much
The Apple Watch will lose its privilege as the secondary display, but will be useful for measuring biometric data and maybe even serve as a on the go touch area for navigation.

So bottom line, as long as Apple doesn’t come up with a way to read your thoughts I only see one product category that might disappear: the MacBook.

 

[eroslws]

Supply chain for lenses isn't particularly difficult, just look at the number of cheap lens providers and the growth of Warby Parker so I'm somewhat excited for Apple to start selling lenses. It would be a shame if Apple partners with Luxottica. If they release the Glasses without a prescription option, it will really go against their entire Accessibility mission. Everyone's looking at this as Apple's entry into AR when it's really another Apple entry into health. Super excited.

 

[Nuno Lopes]

Is seams that lately Apple ecosystem has to resort to rumours to get the tech jagg of excitement and empowerment of the future that we used to get with SJ. We just got out of an event that is supposed to do that and ...

 

[sakurarain]

I only care about the price. Btw. Could be a glass frame of ceramic or titanium?

 

[mariusignorello]

I bet someone in PR put AIRPOWER in the presenter notes on the One More Thing slide and Tim was like, yeah let's skip this.

 

[alpi123]

Amazing how they leave all this info right on their doorstep.

You mean digging into the code which only developers/coders (2 or 3 of them at max) do?

 

[Nuno Lopes]

I have a strong feeling something was cancelled the very last minute. When Tim was talking in the end it looked like he was unsure if to end the keynote or not. I’m sure it was about Apple Tag, but it looks there’re more.

I also got that impression, He seamed to feel that the "pepper" was missing and had nothing to show for.

 

[ayasinsk]

Just because there is evidence that Apple is working on AR headset does not mean it will come out. Look what happened with airpower charger.

 

[Abazigal]

I disagree with your disagreement - I think this is the beginning of the end for the iPhone - and all phones. I believe Apple is going to attempt to kill off the 'phone' as we know it within the next five years, like they have with so many other technologies - floppy disk, cd/dvd-rom, headphone jack, etc). I feel at some point, probably in about 3 to 5 years, they are going to retire the 'iPhone' moniker and call it something entirely new - perhaps some sort of all-in-one iCom device or maybe something as simple as the 'Apple Computer' again (complete 360 from where they started).

Apple likes to kill off complete device categories... it's their way of making a mark on history. I think they'll do it again for the 'phone'. Or at least try to. We'll see.

I don’t think the smartphone is going anywhere. However, like the PC before it, the smartphone is maturing as a product category and as it becomes good enough for the majority of the user populace, the reality is that more of them will simply elect to hold on to their existing smartphones and upgrade at a slower pace regardless of how good the latest offering on the market is.

What Apple is doing is trying to move ahead of this trend by selling to people with iPhones, rather than simply trying to sell more iPhones. You see it with their emphasis on services and accessories.

There is a youtuber, Jon Prosser, who says that what the phone market needs now isn’t innovation but compromise, and I agree with him by and large. This doesn’t mean that companies shouldn’t innovate, but the reality is that the resources invested in fancy new tech like folding displays may never pay for themselves in the form of increased sales.

 

[Vjosullivan]

You all will look dorky and stupid wearing one of these, no one will buy them.

You're right.
[doublepost=1568202838][/doublepost]The slimline spectacles in the picture are just a third party mockup of spectacles with mounted camera.

The article is about AR headsets, which are completely different. Currently they're those big boxes you strap to you face while you wave your arms around like a loony..
[doublepost=1568202942][/doublepost]

They didn’t mention audio zoom for example, which is a major feature.

Now everyone can sound like Mickey Mouse on speed.

 

[Glockworkorange]

This should have never made it into the GM. More evidence of software development incompetence at Apple.

Are they really that incompetent to just leave it in there? Do we really think that?

I think we might hear more about it in October...

 

[Mactendo]

This doesn’t mean that companies shouldn’t innovate, but the reality is that the resources invested in fancy new tech like folding displays may never pay for themselves in the form of increased sales.

It may not pay immediately but it’s moving the technology forward. One day when such tech will mature the unfolding phone may replace tablets.
[doublepost=1568203478][/doublepost]

Now everyone can sound like Mickey Mouse on speed.

Why so?

 

[Ghost31]

I totally agree with this. His ending just felt…off, and it even almost seemed like a “One more thing...” closing fake-out at first.

I’m watching it right now after all the people saying his ending felt off and I just don’t see it. What the heck are you guys talking about? This is the same ending he’s done at every keynote for years. It’s like the same copy and paste formula of “we announced this and that and that and we can’t wait for you to try it blah blah”. See for yourself and tell me at what point it feels “off”. It feels like people hear the rumors about Apple glasses and try to pigeon hole it into this keynote because it was such a boring keynote

The ending is at about the 1:38 mark

 

[WatchAndWait]

I have an Oculous Rift, and it's an amazing device when using an App that truly immerses you in the world. That being said, it still suffers from some hard to avoid side effect - the 'screen door effect' (where you can see the individual pixels of the screen, defeating the illusion of 'being there'), dizziness/vertigo induced feeling, weight of the headset, etc.

Now, I know Apple's headset will be somewhat of a different animal and be lightweight, with a constant view of the real world so many of the problems a traditional VR headset will face won't be an issue with the glasses, but I do worry that there will still be visual/balance issues for some when wearing the headset, and no doubt Apple will test these vigorously before a generalized one hits the streets.

I do wonder what sort of technology they will use to 'paint the pixels' of the display. I'm guessing it will be some sort of HUD-like device that will sit on both the left and right legs of the glasses and project an image onto each lens. Cooler yet would be a 'transparent' LCD display embedded in each lens that would look clear when not turned on but then when turned on display a proper image.

But why would someone who has no need for glasses suddently put on glasses?