Sidebar Sidebar
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

All of the Live Text Updates in iOS 16

MacRumors

MacRumors

macrumors bot
Original poster
Apr 12, 2001
68,143
38,922


Last year in iOS 15, Apple added a feature that is designed to let you highlight and select written and typed text from photos, interacting with it as you would text in any other place in the operating system.


With iOS 16, available now, Apple has continued to improve Live Text, and it has some impressive new capabilities, which we've outlined below.

Live Text in Videos

Video support is the biggest new feature added to Live Text. Rather than just being able to select text in photos, you can now pause a video and interact with the text like you would in an image.

Text in any paused video frame can be copied and pasted or translated, plus it works with Look Up. Live Text works across the operating system in Photos, Camera, Safari, and other apps.

To copy text in a video, pause it on the frame that you want and then touch and hold on a word. You can grab the two blue markers to narrow or widen your selection, and then you can press and hold to get to options like translate and copy.


Quick Actions

Text that is in a photo or a video also supports quick actions, something that Apple added in iOS 15. In iOS 16, there are new quick actions that let you track flights, track packages, translate languages, and convert currencies right from a photo or video.

If you have a photo with a sign in a foreign language, for example, you might see the "Translate" quick action available. Or if there's a foreign currency, Apple will offer up the conversion quick action.


Translate Camera

Apple is using Live Text's functionality in the Translate app, adding a Camera button that opens up the device camera so you can get live translations in real time.

New Languages

Live Text now works with Japanese, Korean, and Ukrainian text in addition to English, Chinese, French, German, Spanish, Italian, and Portuguese.

Live Text Spotlight Search

Live Text capabilities that allow for text to be recognized in photos and videos can be used in Spotlight search in iOS 16, so you can do a Spotlight search to find specific text in an image or video.

Live Text Requirements

Using Live Text features requires an iPhone with an A12 Bionic or later. The iPhone XR, iPhone XS, and iPhone XS Max from 2018 are equipped with an A12 Bionic, so if you have one of these devices or newer you can take advantage of Live Text.

Guide Feedback

Have questions about Live Text in iOS 16, know of a feature we left out, or want to offer feedback on this guide? Send us an email here.

Article Link: All of the Live Text Updates in iOS 16
 
Article Link
https://www.macrumors.com/guide/live-text-ios-16/
Last edited:
  • Like
Reactions: compwiz1202
These are all great. If they can scan the whole video for text seems like they should scan the whole video for faces as well but often seems like it only scans first few seconds.

I know apple has been behind in this area so glad to see them working to catch up.
 
  • Like
Reactions: ikir, mjs916 and Jovijoker
I love MacOS 12's Live Text. It's so cool to just grab text blocks in Preview. The interface is so unpresuming: just select the text to copy, and paste it elsewhere. So much computation happening behind the scenes! I haven't used on iOS/iPadOS, but I'm sure it's just as easy.

Apple experts should show these cool tools to their less technical friends. They will benefit from using these magical tools; they will think fondly of you for showing them the tools.
 
Last edited:
  • Like
Reactions: macguru212, amartinez1660, aloyouis and 3 others
It's a useful feature, but it has added an annoyance when doing certain tasks. A lot of times, if I'm holding down a YouTube thumbnail that has text in it, Live Text will pick it up instead of opening the contextual menu. Hopefully videos aren't going to have the same issue.
 
  • Like
  • Haha
Reactions: amartinez1660, nerdherdster, mjs916 and 5 others
techfreak23 said:
It's a useful feature, but it has added an annoyance when doing certain tasks. A lot of times, if I'm holding down a YouTube thumbnail that has text in it, Live Text will pick it up instead of opening the contextual menu. Hopefully videos aren't going to have the same issue.
Click to expand...
Definitely have the same experience. More often than not I don’t want the live text enabled. anyway to disable it?
 
  • Like
Reactions: japanime, Huck and decypher44
jimbobb24 said:
These are all great. If they can scan the whole video for text seems like they should scan the whole video for faces as well but often seems like it only scans first few seconds.

I know apple has been behind in this area so glad to see them working to catch up.
Click to expand...
That’s not exactly what it does. It scans the current frame for text when you pause the video. It doesn’t scan the whole video for text.
 
  • Like
Reactions: PsykX, mjs916, SFjohn and 2 others
Translate now also works with Turkish which it didn’t in iOS 15 (atleast till the last version I had before I updated to the public beta).

Also another thing I noticed is that within apps if a photo has foreign language sometimes I’m able to select the text on the photos. Same goes for websites. But it doesn’t seem to work all the time, so I’m not sure if this is because it’s actually not all a photo and it’s actual text on a photo background or if Apple is just working out the kinks. If I click and drag around the photo I see the text on the photo being dragged around so assume it’s actually a photo.
 
Live text is awesome wish it worked everywhere. There are still several apps that won’t let me copy the text, I have to take a screenshot, and then save it to photos, then open photos, find the photo, and then copy the text.
 
  • Like
Reactions: AmazeSE and Shifts
BootsWalking said:
My memory has turned into mush ever since I started using the Live Text feature to transcribe names, addresses, phone numbers, etc. Now I have trouble remembering a few digits ;)
Click to expand...
You're sure that's just because of Live Text? Pretty sure my brain was mush before all the nice tech came around :p
 
  • Like
Reactions: BootsWalking
mrgraff said:
Settings > General > Language & Region. Then turn off the toggle button next to “Live Text“.
Click to expand...
Mine was disabled by default, and was looking for a way to enable it, thank you!

Edit: Seems to work fine, except videos in safari, full screen or not. Anyone else have this problem?
 
Last edited:
gaximus said:
Live text is awesome wish it worked everywhere. There are still several apps that won’t let me copy the text, I have to take a screenshot, and then save it to photos, then open photos, find the photo, and then copy the text.
Click to expand...
Ah so it does work in pictures in apps! I agree it’s quite inconsistent. I thought the reason it was inconsistent was because it was only copying actual text when possible instead of text within a picture.
 
I really love Live Text (NOT invented by Apple). Now available in videos,too. Is this amazing? Is it still amazing, when you think of the fact that a video is a series of pictures and then when you pausee/stop a picture is shown, or more exactly a picture is shown with live text enabled?

Ok, it may be a little bit more complicated and may involve more procrocessing.

But here is what I did with a youtube video (amazing, awesome me) using iOS15:


6256AAA2-1D49-44AF-94A3-434ACB5E23F9.jpeg
 
You must log in or register to reply here.
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.
Top Bottom
Back