Apple Releases visionOS 2.4 With Apple Intelligence, Spatial Gallery and New iPhone Integration

[MacRumors]

Apple today released visionOS 2.4, the fourth update to the visionOS 2 operating system that came out in September. visionOS 2.4 comes two months after the launch of visionOS 2.3.

visionOS 2.4 can be downloaded on all Vision Pro headsets by navigating to the Settings app, selecting the General section, and choosing the Software Update option.

The visionOS 2.4 update brings Apple Intelligence to the Vision Pro for the first time, putting it on par with the iPhone, iPad, and Mac. The Vision Pro has an M2 Apple silicon chip inside, and is capable of running the full suite of Apple Intelligence features.

Apple Intelligence features available on the Vision Pro include Writing Tools for generating, proofreading, and summarizing text, Genmoji for creating custom emoji characters, a dedicated Image Playground app for generating images, Memory Movie for creating custom slideshows, smart reply for generating quick responses to texts and emails, Priority Notifications and Notification Summaries, ChatGPT Siri integration and new Siri features, and more.

Along with Apple Intelligence, Apple added a Spatial Gallery app for the Vision Pro. The Spatial Gallery app offers a curated assortment of spatial videos, spatial photos, and panorama images from artists, filmmakers, and photographers. Apple plans to offer a range of content featuring sports, culture, arts, lifestyle, nature, travel, entertainment, and more.

Content at launch includes images and experiences from Cirque du Soleil, Red Bull, Porsche, Samba Diop, and Jonpaul Douglass, along with behind the scenes content from Apple TV+ shows like Severance. Apple's release notes for the update are below.

Apple Intelligence
- Use Writing Tools to rewrite, proofread, and summarize text right in the app you’re working in, and compose text from scratch using ChatGPT
- Quickly respond to messages with Smart Reply in Mail and Messages with suggested responses
- Create unique images in multiple styles using concepts, descriptions, and people from your photo library with Image Playground
- Create custom emoji right from the keyboard and use your Genmoji across the system in your sticker drawer
- Use Image Wand to turn sketches into images in Notes
- Find photos and videos simply by describing what you’re looking for in Photos
- Create a Memory Movie by describing the story you want to see in Photos
- Use priority messages in Mail which understand the content of your messages and prioritize those that require your attention, displaying them at the top of your inbox
- Catch up on your notifications with Priority Notification to make it easy to see a glanceable summary of the most important information

Guest User
- Start a Guest User session with your nearby iPhone or iPad and guide the guest using View Mirroring

Spatial Gallery app
- Discover a curated collection of spatial photos, spatial videos and panoramas, updated regularly

Apple Vision Pro app
- Discover new content, spatial experiences, and quickly access information about your device using Apple Vision Pro app for iPhone when you upgrade to iOS 18.4

This release also includes other features and improvements.
- Use dictation to edit text like replacing or deleting a word
- Activate Travel Mode using the Digital Crown when you see a “tracking fail” notification.

Some features may not be available for all regions. For more information, please visit this website:

visionOS 2

The spatial computing experiences of Apple Vision Pro go even further with visionOS 2. All-new ways to relive memories, play, work, and navigate.

www.apple.com

In iOS 18.4, there is a new Vision Pro app that works in conjunction with visionOS 2.4. With the Vision Pro app, Vision Pro owners can download apps to the Vision Pro, find content to watch and add it to a watch list, and get device info like serial number. There is a dedicated discover page that offers curated recommendations for new and noteworthy experiences, including popular apps and games.

An iPhone can also be used to set up and manage Guest Mode on the Vision Pro, and guests can now save their eye and hand setups for up to 30 days after their last use, making multi-person use more feasible. With an iPhone, Vision Pro owners can block or allow certain apps and guide a user through the Vision Pro interface using AirPlay.

Article Link: Apple Releases visionOS 2.4 With Apple Intelligence, Spatial Gallery and New iPhone Integration

 

[Kylo83]

People don’t really use Apple intelligence on the iPhone so doubt the few with a Vision Pro would use it

 

[BarrettF77]

It's what they are doing to waste dev time. I think that the performance is better on AVP, but still don't use it much. VOS 3.0 will decide if I sell my AVPs off as they just take up space.

 

[jimbobb24]

This looks like an amazing update and I cannot wait to try the Spatial Gallery. Intelligence is great for the things it's great at (summarizing, prioritizing, etc) but dont need the image playground.

 

[Ghost31]

Just downloaded it and then have been using it for the past hour. Pretty cool stuff. Really like the spatial gallery although I don’t see myself using it that much. Probably gonna be one of those things I think is cool for about a week and then I forget about the app even existing

I like the severance behind-the-scenes photos. I think this would be a great opportunity to show more behind the scene stuff of our favorite TV shows and not just 3-D photos.

 

[tywebb13]

build is 22O238

here is the full list of the builds of the other stuff released today:

macOS 15.4 (24E248)
macOS 14.7.5 (23H527)
macOS 13.7.5 (22H527)
iOS 18.4 (22E240)
iPadOS 18.4 (22E240)
tvOS 18.4 (22L255)
audioOS 18.4 (22L255)
iPadOS 17.7.6 (21H423)
iOS 16.7.11 (20H360)
iPadOS 16.7.11 (20H360)
iOS 15.8.4 (19H390)
iPadOS 15.8.4 (19H390)
watchOS 11.4 (22T251) - pulled and re-released next day

 

[Johnstrass2]

This looks like an amazing update and I cannot wait to try the Spatial Gallery. Intelligence is great for the things it's great at (summarizing, prioritizing, etc) but dont need the image playground.

I agree I’m also really looking forward to the app for the iPhone to control the Vision Pro I really wish there was a simple way where I could give my Vision Pro to the guy sitting next to me put it on his head and just press play on my phone to show him a demo of what this incredible device could do
If Apple had something like this, then thousands of us would certainly become evangelist for Apple‘s Vision Pro

 

[krewger]

I just wish the iPhone did projection into the head unit. It’s annoying to have apps and notifications on an iPhone for 2 step authentication and then have to take my Vision Pro off to read my phone because Apple allowed developers to not let apps onto Vision Pro from iOS.

 

[Hajj.david]

People don’t really use Apple intelligence on the iPhone so doubt the few with a Vision Pro would use it

Hard disagree. It was one of the few reasons I returned the AVP. I was using the AVP to do all of my work and I regularly use apple intelligence for emails, professional messages, proof reading, and content creation. With the AVP it is even more important since sometimes I am sitting on my couch without a keyboard and need to quickly review some emails.

The AVP is ultimately a "spatial computer" and used heavily for work (especially now with the amazing virtual monitor support). Apple is almost there, it is really the best and most transformative device I have touched in the past 20-30 years. I will definitely be buying an AVP II.

Before some of you ask why did I return it:
1. I think the pass through needs improvement. I think the processor is the bottleneck here because the cameras are excellent otherwise.
2. The front eye thing was a complete gimmick and useless. Either make it better so its actually usable or scrap it.
3. I really needed apple intelligence, I hated jumping back and forth between the ChatGPT app to edit documents etc.
4. The lack of iPhone mirroring or allowing all iOS apps was a huge headache. Constantly having to switch devices is a PITA especially given you can't authenticate and even once you login the screen is blurry due to number 1.
5. If it is a spatial computer as Apple says, then allow macOS apps. Xcode or other professional apps would be amazing to lock in.
6. I am extremely weary of any first gen Apple product as they tend to kill off support ASAP. Given that this thing has an M2 processor I was constantly anxious that the AVP2 will be far above and beyond better and apple would stop updating the original due to the much weaker processor.

Issues I didn't have or I felt people were blowing it way out of proportion:
1. Weight, pressure, etc proper adjustments made a night and day difference it also stopped me from getting motion sick, which nearly every headset does.
2. Issue of content: Apple was constantly releasing cool things for it and as an entertainment device it is more than perfect

Now these issues I had if the price were lower I would swallow itL $1,999 and the decision would have been much harder to return. I dont mind paying the full $3,500 but then it needs to be a beyond perfect experience.

 

[HDFan]

After the upgrade Siri stopped working. Bubble appears but does not respond to voice commands. After reboot it may work one time then again just get bubble. Once bubble appears you can't get rid of it.

 

[aussie-reader]

At the moment Apple Intelligence is only available for US English on the Vision Pro, hopefully more languages soon.
The biggest missing item for me is telephony integration with my iPhone, answering or making normal phone calls on the Vision Pro would make life a lot easier.

 

[PracticalMatters]

Spatial Gallery app
- Discover a curated collection of spatial photos, spatial videos and panoramas, updated regularly

Unfortunately, it doesn’t look like the Spacial Gallery includes any immersive videos 🤔

 

[craig1410]

Spatial Gallery app
- Discover a curated collection of spatial photos, spatial videos and panoramas, updated regularly

Unfortunately, it doesn’t look like the Spacial Gallery includes any immersive videos 🤔

Immersive videos are not the same thing as Spatial Videos.

You can record a Spatial Video with the AVP and some iPhones such as the iPhone 15 Pro which I have, but you need an immersive camera to record immersive videos. I'm sure they will become more common now that Blackmagic Design have released a (very expensive) immersive camera, but you can probably expect 1000+ Spatial Videos for every Immersive Video you see on an AVP due to the cost of capture and production of Immersive Videos.

 

[turbineseaplane]

It's what they are doing to waste dev time. I think that the performance is better on AVP, but still don't use it much. VOS 3.0 will decide if I sell my AVPs off as they just take up space.

I’m appreciate this sort of real and honest talk

 

[PracticalMatters]

Immersive videos are not the same thing as Spatial Videos.

You can record a Spatial Video with the AVP and some iPhones such as the iPhone 15 Pro which I have, but you need an immersive camera to record immersive videos. I'm sure they will become more common now that Blackmagic Design have released a (very expensive) immersive camera, but you can probably expect 1000+ Spatial Videos for every Immersive Video you see on an AVP due to the cost of capture and production of Immersive Videos.

 

[PracticalMatters]

Yes, thanks… I was aware of most of that. I was just hoping that Apple or other sources might be sponsoring or creating immersive videos to showcase the potential of the platform, especially with this new launch. Interesting about the immersive camera. Hopefully some of that content gets posted there soon!

 

[craig1410]

Yes, I’m aware of that… thank you! I was just hoping that Apple or other sources might be sponsoring or creating immersive videos to showcase the potential of the platform, especially with this new launch.

I didn't mean to appear condescending if that's how it came across, it's just that many people genuinely don't understand the different between immersive and spatial. Also, the new app is called Spatial Gallery so no real suggestion of immersive content from the app name either.

That aside, I think we can safely assume that Apple will be sponsoring or at the very least strongly encouraging the creation of fully immersive content because for a device like the AVP, content is what it needs most. But as I'm sure you are well aware, this is a chicken & egg problem because the audience is currently small (AVP owners) and the content is costly to produce. I'm happy to play my part in this dilemma for now because I've only had my AVP since around Christmas 2024 and content has been steadily trickling out during that time. I think I would have been much more frustrated if I had bought one on day 1 though.

The immersive content we've seen on AVP so far has I think all come via the Apple TV+ app so I think that's where it will continue to appear. At least until the likes of Netflix and other big streaming players introduce native AVP apps or support immersive content some other way. I expect some content will also be downloadable but probably not top tier movies and other shows due to piracy fears.

Anyway, I'm looking forward to visionOS 2.4 mostly because I should be able to share the experience of using my AVP with family and friends more easily with the new guest user features. The Spatial Gallery is part of that of course, but I've already been saving spatial content via my iPhone 15 Pro for the last year or more and panoramas I took years ago also look amazing.

 

[PracticalMatters]

I didn't mean to appear condescending if that's how it came across, it's just that many people genuinely don't understand the different between immersive and spatial. Also, the new app is called Spatial Gallery so no real suggestion of immersive content from the app name either.

That aside, I think we can safely assume that Apple will be sponsoring or at the very least strongly encouraging the creation of fully immersive content because for a device like the AVP, content is what it needs most. But as I'm sure you are well aware, this is a chicken & egg problem because the audience is currently small (AVP owners) and the content is costly to produce. I'm happy to play my part in this dilemma for now because I've only had my AVP since around Christmas 2024 and content has been steadily trickling out during that time. I think I would have been much more frustrated if I had bought one on day 1 though.

The immersive content we've seen on AVP so far has I think all come via the Apple TV+ app so I think that's where it will continue to appear. At least until the likes of Netflix and other big streaming players introduce native AVP apps or support immersive content some other way. I expect some content will also be downloadable but probably not top tier movies and other shows due to piracy fears.

Anyway, I'm looking forward to visionOS 2.4 mostly because I should be able to share the experience of using my AVP with family and friends more easily with the new guest user features. The Spatial Gallery is part of that of course, but I've already been saving spatial content via my iPhone 15 Pro for the last year or more and panoramas I took years ago also look amazing.

You came across just fine and I definitely appreciate your response.
I enjoyed going through the new spacial gallery yesterday and it always has me hoping for more. I also have been taking spacial photos and videos on my iPhone 16, but I was really surprised that last year’s update allowed us to make any old photos into a spacial photos as well. I even had photos of a couple of older family members who passed a few years back and the spacial renderings were so realistic that it was almost eerie. Hopefully we’ll see an immersive gallery as costs come down… and being able to easily share the device is the only way for the masses to fully appreciate the technology.

 

[craig1410]

You came across just fine and I definitely appreciate your response.
I enjoyed going through the new spacial gallery yesterday and it always has me hoping for more. I also have been taking spacial photos and videos on my iPhone 16, but I was really surprised that last year’s update allowed us to make any old photos into a spacial photos as well. I even had photos of a couple of older family members who passed a few years back and the spacial renderings were so realistic that it was almost eerie. Hopefully we’ll see an immersive gallery as costs come down… and being able to easily share the device is the only way for the masses to fully appreciate the technology.

Glad we're on the same wavelength

I hear you when it comes to "hoping for more" and feel the same. I've watched all the "snack size" immersive videos and always come away very impressed but somehow unsatisfied due to the short duration and limited content. I know the immersive camera technology and production can be very expensive but I would happily sit and watch an unedited stream taken from a cafe in Paris or a bridge in Venice.

Of course I would also love to watch a music concert from a virtual front row seat or a plethora of cameras as we saw in the Metallica immersive video. I'm a Formula 1 fan and would almost sell my soul to have an immersive camera strapped to an F1 car and watch the video. I'm also a big tennis fan and have been to Wimbledon twice to watch the stars on centre court. But I would happily pay centre court prices to see that same match from virtual court-side rather than from 80m away at the back of the grandstand.

So much potential - my only fear is liking the virtual world more than the real world! 😅

 

[PracticalMatters]

Absolutely…and I can definitely relate to all of your comments. Just yesterday I had the same conversation with my boys about the Metallica immersive concert and what a cool experience it was to be right there with the band. We went to see the Stones a few months back, and I would have gladly paid the same price for a virtual show with those spectacular views.

Also, we’re big F1 fans as well. We just got back from Monaco and had the chance to sit for a half hour with Roberto Moreno on an early morning train discussing all the drivers and owners. Such a cool time… and I was able to get a few spatial photos! The potential for all of this immersive content is massive. It can definitely take people to places they may never get a chance to visit. Just hope we start seeing more soon!