Apple's Headset Will Reportedly Let Customers Create AR Apps via Siri

[MacRumors]

Apple is working on new software tools that will allow both developers and customers to create augmented reality apps for its widely-rumored AR/VR headset, according to a paywalled report today from The Information's Wayne Ma.

Interestingly, the report claims that customers will be able to create and release AR apps for the headset via Siri, even if they do not have the ability to code:

With the software tools, Apple hopes that even people who don't know computer code could tell the headset, via the Siri voice assistant, to build an AR app that could then be made available via Apple's App Store for others to download. The tool, for example, could allow users to build an app with virtual animals moving around a room and over or around real-life objects without the need to design the animal from scratch, program its animations and calculate its movement in a 3D space with obstacles.

The report likens Apple's tool to Minecraft and Roblox, which allow anyone to easily create 3D tools and worlds. Apple is said to be utilizing technology that it acquired from Montreal-based startup Fabric Software in 2017, and customers would be able to distribute the AR apps they create on the App Store alongside developers.

Apple already offers some AR creation tools like Reality Composer on the iPhone and iPad that could be expanded to the headset.

It's worth noting that the report cites sources who last saw demonstrations of the tool in 2021, so the report is based on older information and it's possible that Apple's plans have changed at least slightly in the time that has passed since.

Apple is also working on AR content for the headset, according to the report:

People familiar with Apple's content strategy for the headset say Apple executives are emphasizing health and wellness including proposals for AR apps that assist with meditation and exercise. One early AR demo allowed users to sit inside a Zen garden, the four people said.

Apple's headset is expected to be released later this year and will reportedly have an iOS-like interface with a grid of apps, advanced eye and hand tracking, and the ability to function as an external display for a Mac. The software tools for the headset could be revealed at Apple's annual developers conference WWDC in June, giving developers time to create AR and VR apps for the headset before it launches to customers later in the year.

Article Link: Apple's Headset Will Reportedly Let Customers Create AR Apps via Siri

 

[mgollaher92]

Yeah, lets have Siri develop apps when it can barely handle turning my lights on and off.

 

[TheYayAreaLiving 🎗️]

The problem is Siri doesn't really like to listen to my commands. Apple really needs to work on fixing and improving Siri first. Will be seeing this error message alot.

 

[nwcs]

That sounds fun for like 5 minutes. Like watching an old 1990s After Dark screen saver.

 

[HobeSoundDarryl]

Imagine the volume of new apps in the App Store created by these non-programmer amateurs collaborating with Siri. Talk about blind leading the blind! Do classic, professional app developers have ANY chance against what should be 'best apps ever'?

And would the deal be 30% right off the top for Apple + 50% for Siri's share as collaborator (so 80% for Apple)?

 

[UltimateSyn]

It's all fun and games until Siri runs into a compiler error.

 

[LoveTo]

What in the ChatGPT? Sounds cool but I’m gonna go out on a limb and claim, Siri will never be able to pull it off. Looking at the speed of improvements since the launch of Siri, realistically it will take at least 200 more years, which is not gonna happen.

 

[Shirasaki]

yeah. Let Siri develop apps for us. What could go wrong?
Confidence inspiring.

 

[HobeSoundDarryl]

It's all fun and games until Siri runs into a compiler error.

"I don't know what you mean by compiler error. Here's what I found on the web for compiler error."

 

[uptownnyc]

Something like this would be slick:

https://twitter.com/i/web/status/1569700294673702912

 

[PhantomStar]

Siri is the worst voice assistance out there, it would probably send you links to look it up yourself again. 'Here's what I found on the web' as usual.

 

[Akrapovic]

This feels like someone heard a rumour and misunderstood it. Like when the iPhone 14 Pro camera cutout was said to have notification indicators in it, and it turned out it was the dynamic island. Or when the Watch S7 was meant to have a flat screen, and it turned out it was an early rumour for the AW Ultra.

This feels more like it'd be a mini sandbox style enviroment where can be like "Hey Siri, add a chair" and it'll drop in objects. Creating entire apps through voice is fantasy. We still can't even do that well with codeless drop n drag systems, never mind trying to explain an app to a voice assistant that struggles with timers.

 

[itsboi]

Have they purchased any AI startups? This sounds like ChatGPT.. I wonder if Siri is going to get a major overhaul if Apple Search is true.

 

[jz0309]

yea, that'll get me apps that want me to spend $3k for this thing ... oh boy

 

[4nNtt]

I hope it doesn't go this way, but with how Siri has been acting lately...

Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - Here is your AR scene, would you like to add content?
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - Here is a cat

 

[turbineseaplane]

LMAO!

I’m lucky if I’m able to correctly create a text message with Siri

 

[blizaine]

With the billions of dollars at Apple's disposal for R&D, I wouldn't be surprised if they are working towards a major update to Siri that incorporates their own NLP AI tech into Siri. It could be trained on Swift and other relevant languages.

 

[xxray]

Yeah, lets have Siri develop apps when it can barely handle turning my lights on and off.

Honestly though. “it looks like you don’t have any HomeKit accessories set up” after she just turned on the light 5 minutes earlier…

 

[mcfrazieriv]

Siri... I want to design a carousel of cards that present my favorite films of Apple TV+ and I want it to be in dark mode.

"One sec... Workin on it... Sorry, didn't quite catch that."

Siri... I want to design a screen that shows my favorite films...

"One sec... Workin on it... Sorry, didn't quite catch that."

SIRI... JUST DISPLAY MY FAVORITE FILM.

"One sec... Workin on it... Sorry, didn't quite catch that."

OK... SIRI. JUST TURN OFF THE TV IN THE LIVING ROOM.

"Okay. Living room lights are off."

 

[Unregistered 4U]

Imagine the volume of new apps in the App Store created by these non-programmer amateurs collaborating with Siri. Do classic, professional app developers have ANY chance against what should be 'best apps ever'?

I don’t have to imagine, I lived through the first days of the iPhone App Store.

 

[lazyrighteye]

Have they purchased any AI startups? This sounds like ChatGPT.. I wonder if Siri is going to get a major overhaul if Apple Search is true.

I wondered the same. IF this was something they are looking to roll out, then I would fully expect the single most significant update to Siri that we've seen to date. I'd be ok with that.

 

[HobeSoundDarryl]

I hope it doesn't go this way, but with how Siri has been acting lately...

Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - Here is your AR scene, would you like to add content?
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - Here is a cat

You are being FARRRRRRRRRR too optimistic in collaborative programmer Siri progress after every 4 verbal prompts. You need to add in a bunch of "I don't know what you mean by reality scene. Here's what I found on the web for reality scene" and "I don't know what you mean by cat. Here's what I found on the web for cat."

 

[Unregistered 4U]

I wondered the same. IF this was something they are looking to roll out, then I would fully expect the single most significant update to Siri that we've seen to date. I'd be ok with that.

I just read a story (maybe from here?) about how the Chatbot is effectively “search” for folks with programming questions. Stackoverflow is good, but not as good as precisely what you want to do using the methods you want to use. No reason why with the right base of knowledge, it couldn’t be expanded into other industries.

 

[hack.opus0y]

With the billions of dollars at Apple's disposal for R&D, I wouldn't be surprised if they are working towards a major update to Siri that incorporates their own NLP AI tech into Siri. It could be trained on Swift and other relevant languages.

I completely agree with this. There’s a piece to the puzzle that’s been under wraps. I expect a Siri overhaul.

 

[HobeSoundDarryl]

I don’t have to imagine, I lived through the first days of the iPhone App Store.

Ahhhh yes. I recall. So App Gold Rush 2.0 is about to begin anew!

And I want Siri creative collaboration in music composition in Garage Band VR. Move over Lennon & McCartney... Siri & Hobe are on the rise.

John to the others: "Where are we going boys?"
Beatles: "To the toppermost of the poppermost, Johnny!"

Hobe to Siri: "Where are we going Siri?"
Siri: "I don't know what you mean by going. Here's what I found on the internet for going."

Not quite the same... but if Siri can code, can top-hit songwriting be any more difficult?*

*Perhaps that's a good question for Siri too?