Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

MacRumors

macrumors bot
Original poster
Apr 12, 2001
63,441
30,638


Apple is working on new software tools that will allow both developers and customers to create augmented reality apps for its widely-rumored AR/VR headset, according to a paywalled report today from The Information's Wayne Ma.

Apple-AR-Icon.jpeg

Interestingly, the report claims that customers will be able to create and release AR apps for the headset via Siri, even if they do not have the ability to code:
With the software tools, Apple hopes that even people who don't know computer code could tell the headset, via the Siri voice assistant, to build an AR app that could then be made available via Apple's App Store for others to download. The tool, for example, could allow users to build an app with virtual animals moving around a room and over or around real-life objects without the need to design the animal from scratch, program its animations and calculate its movement in a 3D space with obstacles.
The report likens Apple's tool to Minecraft and Roblox, which allow anyone to easily create 3D tools and worlds. Apple is said to be utilizing technology that it acquired from Montreal-based startup Fabric Software in 2017, and customers would be able to distribute the AR apps they create on the App Store alongside developers.

Apple already offers some AR creation tools like Reality Composer on the iPhone and iPad that could be expanded to the headset.

It's worth noting that the report cites sources who last saw demonstrations of the tool in 2021, so the report is based on older information and it's possible that Apple's plans have changed at least slightly in the time that has passed since.

Apple is also working on AR content for the headset, according to the report:
People familiar with Apple's content strategy for the headset say Apple executives are emphasizing health and wellness including proposals for AR apps that assist with meditation and exercise. One early AR demo allowed users to sit inside a Zen garden, the four people said.
Apple's headset is expected to be released later this year and will reportedly have an iOS-like interface with a grid of apps, advanced eye and hand tracking, and the ability to function as an external display for a Mac. The software tools for the headset could be revealed at Apple's annual developers conference WWDC in June, giving developers time to create AR and VR apps for the headset before it launches to customers later in the year.

Article Link: Apple's Headset Will Reportedly Let Customers Create AR Apps via Siri
 
Last edited:
  • Haha
Reactions: Razorpit

HobeSoundDarryl

macrumors G5
Imagine the volume of new apps in the App Store created by these non-programmer amateurs collaborating with Siri. Talk about blind leading the blind! Do classic, professional app developers have ANY chance against what should be 'best apps ever'? ;)

And would the deal be 30% right off the top for Apple + 50% for Siri's share as collaborator (so 80% for Apple)? ;)
 
Last edited:

LoveTo

macrumors regular
Oct 3, 2021
115
914
What in the ChatGPT? Sounds cool but I’m gonna go out on a limb and claim, Siri will never be able to pull it off. Looking at the speed of improvements since the launch of Siri, realistically it will take at least 200 more years, which is not gonna happen.
 

Akrapovic

macrumors 65816
Aug 29, 2018
1,193
2,570
Scotland
This feels like someone heard a rumour and misunderstood it. Like when the iPhone 14 Pro camera cutout was said to have notification indicators in it, and it turned out it was the dynamic island. Or when the Watch S7 was meant to have a flat screen, and it turned out it was an early rumour for the AW Ultra.

This feels more like it'd be a mini sandbox style enviroment where can be like "Hey Siri, add a chair" and it'll drop in objects. Creating entire apps through voice is fantasy. We still can't even do that well with codeless drop n drag systems, never mind trying to explain an app to a voice assistant that struggles with timers.
 

itsboi

macrumors 6502
Sep 23, 2015
287
616
Have they purchased any AI startups? This sounds like ChatGPT.. I wonder if Siri is going to get a major overhaul if Apple Search is true.
 
  • Like
Reactions: josselinco

4nNtt

macrumors 6502a
Apr 13, 2007
913
664
Chicago, IL
I hope it doesn't go this way, but with how Siri has been acting lately...

Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - Here is your AR scene, would you like to add content?
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - Here is a cat
 

blizaine

macrumors 6502
Sep 17, 2003
355
157
With the billions of dollars at Apple's disposal for R&D, I wouldn't be surprised if they are working towards a major update to Siri that incorporates their own NLP AI tech into Siri. It could be trained on Swift and other relevant languages.
 

mcfrazieriv

macrumors 65816
Jan 30, 2012
1,103
2,833
Siri... I want to design a carousel of cards that present my favorite films of Apple TV+ and I want it to be in dark mode.

"One sec... Workin on it... Sorry, didn't quite catch that."

Siri... I want to design a screen that shows my favorite films...

"One sec... Workin on it... Sorry, didn't quite catch that."

SIRI... JUST DISPLAY MY FAVORITE FILM.

"One sec... Workin on it... Sorry, didn't quite catch that."

OK... SIRI. JUST TURN OFF THE TV IN THE LIVING ROOM.

"Okay. Living room lights are off."
 

Unregistered 4U

macrumors G3
Jul 22, 2002
9,888
7,807
Imagine the volume of new apps in the App Store created by these non-programmer amateurs collaborating with Siri. Do classic, professional app developers have ANY chance against what should be 'best apps ever'? ;)
I don’t have to imagine, I lived through the first days of the iPhone App Store. :)
 

lazyrighteye

Contributor
Jan 16, 2002
4,094
6,307
Denver, CO
Have they purchased any AI startups? This sounds like ChatGPT.. I wonder if Siri is going to get a major overhaul if Apple Search is true.
I wondered the same. IF this was something they are looking to roll out, then I would fully expect the single most significant update to Siri that we've seen to date. I'd be ok with that.
 
  • Like
Reactions: HobeSoundDarryl

HobeSoundDarryl

macrumors G5
I hope it doesn't go this way, but with how Siri has been acting lately...

Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Create a reality scene
Siri - Here is your AR scene, would you like to add content?
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - I'm having trouble connecting, try again in a few minutes
Hey Siri, Add a cat to the scene
Siri - Here is a cat

You are being FARRRRRRRRRR too optimistic in collaborative programmer Siri progress after every 4 verbal prompts. You need to add in a bunch of "I don't know what you mean by reality scene. Here's what I found on the web for reality scene" and "I don't know what you mean by cat. Here's what I found on the web for cat." ;)
 

Unregistered 4U

macrumors G3
Jul 22, 2002
9,888
7,807
I wondered the same. IF this was something they are looking to roll out, then I would fully expect the single most significant update to Siri that we've seen to date. I'd be ok with that.
I just read a story (maybe from here?) about how the Chatbot is effectively “search” for folks with programming questions. Stackoverflow is good, but not as good as precisely what you want to do using the methods you want to use. No reason why with the right base of knowledge, it couldn’t be expanded into other industries.
 
  • Like
Reactions: lazyrighteye

hack.opus0y

macrumors newbie
Aug 29, 2022
9
3
With the billions of dollars at Apple's disposal for R&D, I wouldn't be surprised if they are working towards a major update to Siri that incorporates their own NLP AI tech into Siri. It could be trained on Swift and other relevant languages.
I completely agree with this. There’s a piece to the puzzle that’s been under wraps. I expect a Siri overhaul.
 
  • Like
Reactions: chfilm

HobeSoundDarryl

macrumors G5
I don’t have to imagine, I lived through the first days of the iPhone App Store. :)

Ahhhh yes. I recall. So App Gold Rush 2.0 is about to begin anew!

And I want Siri creative collaboration in music composition in Garage Band VR. Move over Lennon & McCartney... Siri & Hobe are on the rise.

John to the others: "Where are we going boys?"
Beatles: "To the toppermost of the poppermost, Johnny!"

Hobe to Siri: "Where are we going Siri?"
Siri: "I don't know what you mean by going. Here's what I found on the internet for going."

Not quite the same... but if Siri can code, can top-hit songwriting be any more difficult?* ;)

*Perhaps that's a good question for Siri too?
 
Last edited:
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.