Apple's Big Push to Improve Accessibility in iOS 13, iPadOS, and macOS Catalina

MacRumors

macrumors bot
Original poster
Apr 12, 2001
49,131
10,476



Apple is introducing several accessibility-friendly features with iOS 13, iPadOS, and macOS Catalina, including Voice Control, Hover Text, and Mouse Pointer Support for iPhones and iPads.

After the company's WWDC keynote on Monday, TechCrunch's iOS accessibility expert Steven Aquino sat down with Apple's Sarah Herrlinger, director of Global Accessibility Policy & Initiatives, who offered further details on the thinking behind Apple's latest, and arguably greatest, accessibility push.


Voice Control

Herrlinger first opened up about Apple's new Voice Control feature, which earned its own slide space during Craig Federighi's onstage presentation. Voice Control supports editing and menu navigation in both macOS Catalina and iOS 13, but it was the feature's advanced dictation capabilities that Herrlinger was most eager to highlight.
For example, Herrlinger explained how you can say "show numbers" in Safari's Favorites view and little numbers, corresponding to the number of favorites you have, show up beside a website's favicon. Say TechCrunch is No. 2 in your list of favorites. If the glyph is hard to make out visually, saying "open 2" will prompt Voice Control to launch TechCrunch's page. Likewise, you can say "show grid" and a grid will appear so you perform actions such as clicking, tapping or pinching-and-zooming.
Herrlinger said Apple has worked hard to improve Voice Control's speech detection system, so that it can more adeptly parse users with different types of speech, such as those who stutter.

On iOS, the feature also utilizes attention awareness to know when a user with physical motor limitations is interacting with their device. Allaying privacy concerns, Apple says that none of the audio processed by Voice Control can be accessed by anyone else, including Apple, thanks to built-in anonymity and encryption.

Hover Text for macOS

Another feature Herrlinger was keen to demo was something called Hover Text on macOS. Described as a subset of the existing Zoom functionality, Hover Text enables the user to place the mouse pointer over a selection of text to get a bubble with the text enlarged.
Herrlinger told me the feature works system-wide, even in places like the menu bar. And yes, Hover Text is indeed customizable; users have access to a wide variety of fonts and colors to make Hover Text's "bubbles" their own. Text size can be enlarged up to 128pt, Herrlinger said. What this means is users can play with different permutations of the feature to find which label(s) work best -- say, a yellow background with dark blue text set in Helvetica for the highest contrast. The possibilities are virtually endless, a testament to how rich the feature is despite its simplicity.
According to Herrlinger, Apple could have brought iOS feature Dynamic Type to the Mac, but found Hover Text accomplished the same goal of enlarging text in a way that felt better suited to its desktop operating system.

Mouse Support for iPhone and iPad

iPadOS and iOS 13 introduces mouse support for the first time, allowing a USB mouse to be connected to an iPad and iPhone for the first time.

Mouse support is not a standard feature, but is instead available as an AssistiveTouch option, designed for users with physical motor delays who can't easily interact with the touchscreen itself. Apple says it works with both USB and Bluetooth mice, although the company doesn't yet have an official compatibility list. According to developer Steve Troughton-Smith, who first discovered the feature, it also works with the Apple Magic Trackpad.
When I asked why build pointer support into a touch-based operating system, Herrlinger was unequivocal in her answer: it serves a need in the accessibility community. "This is not your old desktop cursor as the primary input method," she said.

The reality is, it's not your secondary choice, either. The bottom line is that, while Apple loves the idea of accessibility features being adopted by the mainstream, pointer support in iOS 13 and iPadOS really isn't the conventional PC input mechanism at all. In this case, it's a niche feature that should suit a niche use case; it's not supposed to represent the milestone of iPad's productivity growth that many think it could be. Maybe that changes over time, but for now, it's the new Mac Pro of software: not for everyone, not even for most people.
According to Herrlinger, Apple recognizes that people without disabilities will use this feature. "For example, many people find value in closed captions," she said. "Our goal is to engineer for specific use cases so that we continue to bring the power of our devices to more people."

Hello mouse support on iOS 13! It's an AssistiveTouch feature, and works with USB mice. @viticci nailed this pic.twitter.com/nj6xGAKSg0 - Steve Troughton-Smith (@stroughtonsmith) June 3, 2019

That being said, Herrlinger was quick to emphasize that mouse support should be seen in context. In other words, Apple hasn't introduced it to drastically alter the primary user input landscape of iOS, although that being said, it's not going to stop anyone outside its intended use case from plugging a mouse into their iPad Pro.

iOS 13, iPadOS, and macOS Catalina are only available to registered developers at this time, but later in the summer, Apple plans to make public betas available, giving public beta testers a chance to try the software before it sees a public launch in the fall.

Article Link: Apple's Big Push to Improve Accessibility in iOS 13, iPadOS, and macOS Catalina
 

Aston441

macrumors 68000
Sep 16, 2014
1,505
2,169
Why are you dragging your feet Apple? Just make it a regular mouse cursor, like it was figured out to be, by Xerox, decades ago, to be one of the fastest and most comfortable ways to interact with a computer.

Just stop being weird.

You're going to add it eventually and we all know it. Just paste in the code.

Jerks.

I can't believe a closed, locked down OS became the most popular again.

Have we learned nothing from the Windows debacle? Apple is behaving worse than Microsoft ever did.
 

Techwatcher

macrumors 6502
Sep 21, 2013
273
396
NYC
Apple needs to understand that adding in full mouse support does not mean any of us will start throwing our Apple Pencils into the incinerator. They can work together quite beautifully, we're not that simple minded. Everything has a use case--they need to stop forcing all use cases into 1 workflow.
 

Khedron

macrumors 68020
Sep 27, 2013
2,152
4,240
Apple needs to understand that adding in full mouse support does not mean any of us will start throwing our Apple Pencils into the incinerator. They can work together quite beautifully, we're not that simple minded. Everything has a use case--they need to stop forcing all use cases into 1 workflow.
Apple are terrified that if they allow standards to work on their devices someone might get an Apple Pencil 1 working on an iPad Pro, or a Pencil 2 on a non-Pro iPad.

And that would basically be stealing money straight from Apple.
 
  • Like
Reactions: DevNull0

TMRJIJ

macrumors 68040
Dec 12, 2011
3,246
5,413
South Carolina, United States
I can only really accept mouse support if the iPad is docked on a keyboard. Otherwise, it should not be a common primary input. iPadOS/iOS is a touch-centric OS just like macOS is a precision mouse OS. It’s never good to conflate or switch the two.
I’ve always hated when people try to justify a touch-screen laptop. It’s not ergonomically practical and the desktop UI doesn’t work with touch.
 

BootsWalking

macrumors 65816
Feb 1, 2014
1,306
7,641
Apple is kidding themselves if they think a large contingent of iPad users won’t be clamoring for a more refined and feature-complete implementation of mouse support. With Photoshop just around the corner, precise mouse pointer support will be a necessity.
 
  • Like
Reactions: Sandstorm

mi7chy

macrumors 604
Oct 24, 2014
6,620
7,640
What is the motive for hiding ordinary features like mouse support under accessibility? Is it because of shame for backtracking, playing into the hearts of consumers that they really care about disabilities, weird rebranding, etc.? No other mouse supported OS does this.
 

bb9

macrumors member
Apr 1, 2017
90
52
Android have these features already?? Apple is late again?
 

cgaw23

macrumors newbie
Oct 17, 2015
27
13
I’ve always used Siri, but Apple has seriously fallen behind in the performance of their voice detection compared to their competitors. I’m glad they are working it.
One thing I wish they would do is make Apple Music available on gaming consoles and TVs with android software. Spotify users can play music on pretty much any device in their house while Apple Music users are strictly limited
 

vidjahgamz

macrumors regular
Oct 29, 2017
117
183
Pennsylvania


Mouse Support for iPhone and iPad

When I asked why build pointer support into a touch-based operating system, Herrlinger was unequivocal in her answer: it serves a need in the accessibility community. "This is not your old desktop cursor as the primary input method," she said.

The reality is, it's not your secondary choice, either. The bottom line is that, while Apple loves the idea of accessibility features being adopted by the mainstream, pointer support in iOS 13 and iPadOS really isn't the conventional PC input mechanism at all. In this case, it's a niche feature that should suit a niche use case; it's not supposed to represent the milestone of iPad's productivity growth that many think it could be. Maybe that changes over time, but for now, it's the new Mac Pro of software: not for everyone, not even for most people.
So.... if the mouse support isn't going to be like the conventional PC input mechanism than how different will it be from the standard experience? I'm curious.
 

Lounge vibes 05

macrumors 6502
May 30, 2016
410
997
I can't blame Apple for this, because it is a Beta. But I am a blind user, who uses voice over daily, and iOS 13 is the worst that is has ever been. The App Store will not launch if VO is turned on.
Apple Music refuses to download onto my phone. I am just praying that Beta 2 drops soon. And really soon
 
  • Like
Reactions: rjp1

Romeo_Nightfall

macrumors 6502a
Aug 8, 2018
639
672
Vienna
I can only really accept mouse support if the iPad is docked on a keyboard. Otherwise, it should not be a common primary input. iPadOS/iOS is a touch-centric OS just like macOS is a precision mouse OS. It’s never good to conflate or switch the two.
I’ve always hated when people try to justify a touch-screen laptop. It’s not ergonomically practical and the desktop UI doesn’t work with touch.
So You are a hater who tells other people what they should do, please report yourself!
 
  • Like
Reactions: sinsin07

Lounge vibes 05

macrumors 6502
May 30, 2016
410
997
Why are you dragging your feet Apple? Just make it a regular mouse cursor, like it was figured out to be, by Xerox, decades ago, to be one of the fastest and most comfortable ways to interact with a computer.

Just stop being weird.

You're going to add it eventually and we all know it. Just paste in the code.

Jerks.

I can't believe a closed, locked down OS became the most popular again.

Have we learned nothing from the Windows debacle? Apple is behaving worse than Microsoft ever did.
Go back and watch Steve Jobs introduce the Macintosh. Then watch him introduce the iPad. One is made for full mouse support, and one is made for touch support. If you want a mouse, by a Mac. That why you have the choice
 
  • Like
Reactions: mdriftmeyer

Darth Tulhu

macrumors 6502a
Apr 10, 2019
676
994
I can only really accept mouse support if the iPad is docked on a keyboard. Otherwise, it should not be a common primary input. iPadOS/iOS is a touch-centric OS just like macOS is a precision mouse OS. It’s never good to conflate or switch the two.
I’ve always hated when people try to justify a touch-screen laptop. It’s not ergonomically practical and the desktop UI doesn’t work with touch.
You mean like this?


Or this?
 

now i see it

macrumors 603
Jan 2, 2002
5,368
10,860
Their philosophy is (and always will be) get a Mac if you want a real mouse. An identical mouse behavior will never come to iPad.
 

Darth Tulhu

macrumors 6502a
Apr 10, 2019
676
994
Go back and watch Steve Jobs introduce the Macintosh. Then watch him introduce the iPad. One is made for full mouse support, and one is made for touch support. If you want a mouse, by a Mac. That why you have the choice
Why can't we have BOTH on the iPad (NOT the Mac)?

Did you see the amount of weirdo-swiping we have to muscle-memorize just to copy and paste some text??

Don't get me wrong, I'm happy to have it and learn it for when I DON'T have a mouse or (Apple) trackpad, but it'd be MUCH easier to do otherwise.

Hopefully now WE get to choose.

Like with all OTHER (non-Apple) devices on Earth.
[doublepost=1559847688][/doublepost]
Their philosophy is (and always will be) get a Mac if you want a real mouse. An identical mouse behavior will never come to iPad.
Why not?
 
  • Like
Reactions: rjp1

metalsiren

macrumors 6502a
Oct 28, 2017
567
623
Android have these features already?? Apple is late again?
This, I have used a mouse on android and it works, even scroll works on web pages etc. and I am not talking about desktop mode, it works in native. and its a REGULAR pointer. not some weird circle from hell,
 
  • Like
Reactions: Aston441

Macaholic868

macrumors 6502
Feb 2, 2017
433
515
I absolutely love this feature!!! The one thing that prevents me from going on vacation with an iPad alone leaving my laptop behind is that I need to be able to use Microsoft’s RD client to connect to my system at the office and do work that requires a mouse from time to time.

I can bumble my way through it with touch if it’s just adjusting a line or two of code but anything more than that and forget it on anything but a laptop or desktop with a mouse.

With mouse support I can take my iPad Pro with me and be safe in the knowledge that I’m covered if I have to do something more complex on my work PC that requires the precision of a mouse instead of touch through the RD interface! For me this one is a game changer!!!
 
Last edited:
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.