Toggle sidebar Toggle sidebar
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

Apple Previews New Accessibility Features Powered by Apple Intelligence

MacRumors

MacRumors

macrumors bot
Original poster


Apple today announced a suite of accessibility updates that use Apple Intelligence to expand capabilities across VoiceOver, Magnifier, Voice Control, and Accessibility Reader, with additional new features for generated subtitles and wheelchair control via Apple Vision Pro.

iOS-27-Accessibility-Feature.jpg

Apple Intelligence powers several of the new features coming later this year:

  • VoiceOver Image Explorer uses Apple Intelligence to produce more detailed descriptions of images throughout the system, including photographs, scanned bills, and personal records. Users can also press the Action button on the iPhone to ask questions about what the camera viewfinder sees, with follow-up questions supported in natural language.
  • Magnifier brings Apple Intelligence-powered visual descriptions to its high-contrast interface for users with low vision, also accessible via the Action button, with support for spoken commands like "zoom in" or "turn on flashlight."
  • Voice Control gains natural language input so users can describe onscreen elements conversationally, such as "tap the guide about best restaurants" or "tap the purple folder," rather than memorizing exact label names or numbers. Apple says the feature can also help where on-screen elements lack proper accessibility labels.
  • Accessibility Reader gains support for more complex document layouts including scientific articles with multiple columns, images, and tables, plus on-demand summaries and built-in translation that retains a user's custom font, color, and formatting preferences.
  • Generated Subtitles use on-device speech recognition to automatically transcribe spoken audio in uncaptioned video content, including clips recorded on iPhone, received from friends and family, or streamed online, across the iPhone, iPad, Mac, Apple TV, and Apple Vision Pro. Initially available in English in the U.S. and Canada.
  • Power Wheelchair Control for Apple Vision Pro uses the headset's precision eye-tracking system as an alternative input method for users who cannot operate a joystick, launching with support for the Tolt and LUCI alternative drive systems in the U.S. via Bluetooth and wired connections.

Apple shared a video about the new Voiceover feature:



Apple also announced a number of smaller additions coming later this year:
  • Vehicle Motion Cues are coming to visionOS to help reduce motion sickness when using Vision Pro as a passenger in a moving vehicle.
  • Apple Vision Pro will support face gestures for performing taps and system actions, plus a new way to select elements with one's eyes while using Dwell Control.
  • Made for iPhone hearing aids will gain more reliable pairing and handoff between Apple devices, with an improved setup experience across iOS, iPadOS, macOS, and visionOS.
  • Name Recognition, which notifies users who are deaf or hard of hearing if someone says their name, expands to more than 50 languages globally.
  • Larger Text support is coming to tvOS, allowing viewers with low vision to increase onscreen text size.
  • Sony Access controller is gaining support as a game controller on iOS, iPadOS, and macOS, with full button and thumbstick customization and support for combining two controllers.
  • FaceTime gains a new API allowing sign language interpretation app developers to add a human interpreter to an ongoing video call.
  • Touch Accommodations gain a new way to personalize setup in iOS and iPadOS.

Starting today, the Hikawa Grip & Stand for iPhone, an adaptive MagSafe accessory designed by Los Angeles-based designer Bailey Hikawa, is available globally in three new colors via the Apple Store online. The accessory was developed in collaboration with individuals with disabilities affecting grip, strength, and mobility, and is now available internationally via a partnership with PopSockets.

All of the announced features are expected to arrive later this year. Voice Control's natural language capabilities will be available in English in the U.S., Canada, the UK, and Australia.

Today's announcement is part of Apple's annual tradition of previewing upcoming accessibility features ahead of Global Accessibility Awareness Day, which falls on the third Thursday of May each year. While no firm release date is given for the features, they typically arrive with Apple's new operating system updates in the fall. This year that means iOS 27, iPadOS 27, macOS 27, tvOS 27, and visionOS 27, all of which are expected to be unveiled at WWDC in June before shipping in September.

Article Link: Apple Previews New Accessibility Features Powered by Apple Intelligence
 
Article Link
https://www.macrumors.com/2026/05/19/new-accessibility-features-with-apple-intelligence/
Last edited:
  • Haha
Reactions: Z-4195
MacRumors said:
Power Wheelchair Control for Apple Vision Pro uses the headset's precision eye-tracking system as an alternative input method for users who cannot operate a joystick, launching with support for the Tolt and LUCI alternative drive systems in the U.S. via Bluetooth and wired connections.
Click to expand...

Wait a minute. The user can't operate a joystick but is going to have a VR headset on?
 
  • Love
Reactions: _Mitchan1999
On the topic of game controllers. Still no support for the Switch 2 Controller or Pro Controller 2. Switch 2 is coming up on a year of being released.
 
Lots of new features for the Vision Pro… yet just a week or so ago MacRumors reported the project is dead and all team members were sent to other teams?
 
I wonder how many people there are that have power wheelchairs, can't use the stick, are in the US, have Tolt and LUCI alternative drive systems, and an AVP. Like, couldn't that be zero?
 
  • Like
Reactions: turbineseaplane
  • Power Wheelchair Control for Apple Vision Pro uses the headset's precision eye-tracking system as an alternative input method for users who cannot operate a joystick, launching with support for the Tolt and LUCI alternative drive systems in the U.S. via Bluetooth and wired connections.
Click to expand...
I am fortunate, not needing any of these supporting controls, but imagine, what this means for them who need it. Remember Stephen Hawking. This must be an incredible addition to their independence. I am really thrilled to read that.
 
  • Like
Reactions: Letrix
Apple likes to place a big emphasis on their accessibility features. So can someone explain why their local voice dictation is still so bad? I would think that excellent voice dictation would be table stakes for accessibility at this point.

But when compared to alternatives, many of which are open-source and local, Apple’s own voice dictation is so far behind. I still have to say things like “period” and “comma” when dictating, and the words are often wrong. The alternatives are nearly flawless by comparison.

It seems like such an easy thing to improve, and it would be a massive quality of life improvement for millions of users who don’t download 3rd party alternatives. I must be missing something…
 
  • Love
Reactions: turbineseaplane and ProbablyDylan
MacRumors said:


Apple today announced a suite of accessibility updates that use Apple Intelligence to expand capabilities across VoiceOver, Magnifier, Voice Control, and Accessibility Reader, with additional new features for generated subtitles and wheelchair control via Apple Vision Pro.

iOS-27-Accessibility-Feature.jpg

Apple Intelligence powers several of the new features coming later this year:

  • VoiceOver Image Explorer uses Apple Intelligence to produce more detailed descriptions of images throughout the system, including photographs, scanned bills, and personal records. Users can also press the Action button on the iPhone to ask questions about what the camera viewfinder sees, with follow-up questions supported in natural language.
  • Magnifier brings Apple Intelligence-powered visual descriptions to its high-contrast interface for users with low vision, also accessible via the Action button, with support for spoken commands like "zoom in" or "turn on flashlight."
  • Voice Control gains natural language input so users can describe onscreen elements conversationally, such as "tap the guide about best restaurants" or "tap the purple folder," rather than memorizing exact label names or numbers. Apple says the feature can also help where on-screen elements lack proper accessibility labels.
  • Accessibility Reader gains support for more complex document layouts including scientific articles with multiple columns, images, and tables, plus on-demand summaries and built-in translation that retains a user's custom font, color, and formatting preferences.
  • Generated Subtitles use on-device speech recognition to automatically transcribe spoken audio in uncaptioned video content, including clips recorded on iPhone, received from friends and family, or streamed online, across the iPhone, iPad, Mac, Apple TV, and Apple Vision Pro. Initially available in English in the U.S. and Canada.
  • Power Wheelchair Control for Apple Vision Pro uses the headset's precision eye-tracking system as an alternative input method for users who cannot operate a joystick, launching with support for the Tolt and LUCI alternative drive systems in the U.S. via Bluetooth and wired connections.

Apple also announced a number of smaller additions coming later this year:
  • Vehicle Motion Cues are coming to visionOS to help reduce motion sickness when using Vision Pro as a passenger in a moving vehicle.
  • Apple Vision Pro will support face gestures for performing taps and system actions, plus a new way to select elements with one's eyes while using Dwell Control.
  • Made for iPhone hearing aids will gain more reliable pairing and handoff between Apple devices, with an improved setup experience across iOS, iPadOS, macOS, and visionOS.
  • Name Recognition, which notifies users who are deaf or hard of hearing if someone says their name, expands to more than 50 languages globally.
  • Larger Text support is coming to tvOS, allowing viewers with low vision to increase onscreen text size.
  • Sony Access controller is gaining support as a game controller on iOS, iPadOS, and macOS, with full button and thumbstick customization and support for combining two controllers.
  • FaceTime gains a new API allowing sign language interpretation app developers to add a human interpreter to an ongoing video call.
  • Touch Accommodations gain a new way to personalize setup in iOS and iPadOS.

Starting today, the Hikawa Grip & Stand for iPhone, an adaptive MagSafe accessory designed by Los Angeles-based designer Bailey Hikawa, is available globally in three new colors via the Apple Store online. The accessory was developed in collaboration with individuals with disabilities affecting grip, strength, and mobility, and is now available internationally via a partnership with PopSockets.

All of the announced features are expected to arrive later this year. Voice Control's natural language capabilities will be available in English in the U.S., Canada, the UK, and Australia.

Today's announcement is part of Apple's annual tradition of previewing upcoming accessibility features ahead of Global Accessibility Awareness Day, which falls on the third Thursday of May each year. While no firm release date is given for the features, they typically arrive with Apple's new operating system updates in the fall. This year that means iOS 27, iPadOS 27, macOS 27, tvOS 27, and visionOS 27, all of which are expected to be unveiled at WWDC in June before shipping in September.

Article Link: Apple Previews New Accessibility Features Powered by Apple Intelligence
Click to expand...

For all my frustrations with Apple, I do appreciate their investments in accessibility. I don't benefit from it directly but it is something I'm glad they continue to do. I believe they've been a leader in this (at least among mainstream devices).
 
  • Like
Reactions: turbineseaplane
As a VoiceOver user I'm excited about this. I'm getting the number one feature I've wanted since the beginning roll out of Apple Intelligence in iOS 18, that being native AI descriptions of photos. Android already has this on phones with Gemini, though I've never used it.

A couple years ago, Apple added the ability to mark up photos with image descriptions, like alt tags in images on websites. This is awesome, combined with third party AI apps that can generate descriptions, but the workflow is time consuming. I'm hoping this AI upgrade to VoiceOver's image explorer will make that easier. These AI features are another tool to have to increase independence, I don't always have someone around to verify the AI descriptions. Most of the time it gets everything right and it blows sighted people's minds when I show them, but I have had times where it gets things wrong.

Of course Apple puts in their disclaimer about not relying on features in certain situations, and that makes sense. But that also means I probably won't ever get the other feature I really want -- the ability to point your iPhone camera at a cross walk light or the painted lines onthe street to help maintain a straight line while crossing. A lot of people with no vision have issues with that.
 
You must log in or register to reply here.
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.
Top Bottom
Back