Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

MacRumors

macrumors bot
Original poster
Apr 12, 2001
67,875
38,561


For ‌iPhone 16‌ models, Apple's iOS 18.3 software update adds new Visual Intelligence features to the Camera Control button. Keep reading to learn what you can do with the new capabilities and how to use them.

Apple-Visual-Intelligence.jpg

New Visual Intelligence Features

In iOS 18.2, Apple's previous point update, the company added Visual Intelligence functionality to its latest iPhone 16 models, allowing device owners to point the camera at the world around them and get details about places, summarize and translate text, go to website links, call phone numbers, and more.

In iOS 18.3, Apple adds new capabilities to Visual Intelligence, including an option to create a calendar event when viewing a poster or flyer, as well as the ability to easily identify plants, animals, and insects.

iphone-16-hands-on-camera-control.jpg

Bear in mind that ‌Visual Intelligence‌ is an Apple Intelligence feature that is exclusive to the ‌iPhone 16‌ models – if you have an older model, you won't have a Camera Control button below the Side button on the right-hand side of your device.

Activating Visual Intelligence

To activate Visual Intelligence, press and hold the Camera Control button for a few seconds. A regular press simply opens the camera with Camera Control, so the press-and-hold gesture is necessary. Ensure the Camera app isn't already active, as Visual Intelligence won't work if the camera is already in use.

The Visual Intelligence interface includes a camera view, a capture button, and "Ask" and "Search" options. The "Ask" button interacts with ChatGPT, while "Search" sends the captured image to Google Search.

visual-intelligence-buttons.jpg

To use Visual Intelligence, you must take a photo of the object or scene you're observing. Use the Camera Control button to snap a picture, then select your desired option. It doesn't support live camera views or previously saved photos.

Create a Calendar Event From a Poster

Using ‌Visual Intelligence‌ to add an event to Calendar was a promised function that Apple showed off when introducing Camera Control, and it will be usable in iOS 18.3.

create-event-visual-intelligence.jpg

To add an event, view a document such as a poster with a date, and then tap on the date when the feature pops up in the ‌Visual Intelligence‌ interface.

Identify Pets, Animals, and Insects

The Photos app is already able to provide insight into plants, animals, and insects when opting to view additional information in the editing interface, but Camera Control will now show these details in real-time.

ios-18-3-camera-control-animals.jpg

When viewing an animal or a plant with ‌Visual Intelligence‌, you may see a tappable bubble at the top of the viewfinder that lets you know what you're looking at. Simply tap it to view more information. If the output is incorrect, you can use the thumbs up and thumbs down icons below the card to submit feedback to Apple.

Article Link: iOS 18.3: Use New Visual Intelligence Features on iPhone 16
 
Last edited:
In iOS 18.2, Apple's previous point update, the company added Visual Intelligence functionality to its latest iPhone 16 models, allowing device owners to point the camera at the world around them and get details about places, summarize and translate text, go to website links, call phone numbers, and more.

In iOS 18.3, Apple adds new capabilities to Visual Intelligence, including an option to create a calendar event when viewing a poster or flyer, as well as the ability to easily identify plants, animals, and insects.
With the known shortcomings of Apple Intelligence, I'm supposed to trust that Apple's Visual Intelligence will provide me with correct info on things I'm point the camera at?
 


For ‌iPhone 16‌ models, Apple's imminent iOS 18.3 software update adds new Visual Intelligence features to the Camera Control button. Keep reading to learn what you can do with the new capabilities and how to use them.

Apple-Visual-Intelligence.jpg

New Visual Intelligence Features

In iOS 18.2, Apple's previous point update, the company added Visual Intelligence functionality to its latest iPhone 16 models, allowing device owners to point the camera at the world around them and get details about places, summarize and translate text, go to website links, call phone numbers, and more.

In iOS 18.3, Apple adds new capabilities to Visual Intelligence, including an option to create a calendar event when viewing a poster or flyer, as well as the ability to easily identify plants, animals, and insects.

iphone-16-hands-on-camera-control.jpg

Bear in mind that ‌Visual Intelligence‌ is an Apple Intelligence feature that is exclusive to the ‌iPhone 16‌ models – if you have an older model, you won't have a Camera Control button below the Side button on the right-hand side of your device.

Activating Visual Intelligence

To activate Visual Intelligence, press and hold the Camera Control button for a few seconds. A regular press simply opens the camera with Camera Control, so the press-and-hold gesture is necessary. Ensure the Camera app isn't already active, as Visual Intelligence won't work if the camera is already in use.

The Visual Intelligence interface includes a camera view, a capture button, and "Ask" and "Search" options. The "Ask" button interacts with ChatGPT, while "Search" sends the captured image to Google Search.

visual-intelligence-buttons.jpg

To use Visual Intelligence, you must take a photo of the object or scene you're observing. Use the Camera Control button to snap a picture, then select your desired option. It doesn't support live camera views or previously saved photos.

Create a Calendar Event From a Poster

Using ‌Visual Intelligence‌ to add an event to Calendar was a promised function that Apple showed off when introducing Camera Control, and it will be usable in iOS 18.3.

create-event-visual-intelligence.jpg

To add an event, view a document such as a poster with a date, and then tap on the date when the feature pops up in the ‌Visual Intelligence‌ interface.

Identify Pets, Animals, and Insects

The Photos app is already able to provide insight into plants, animals, and insects when opting to view additional information in the editing interface, but Camera Control will now show these details in real-time.

ios-18-3-camera-control-animals.jpg

When viewing an animal or a plant with ‌Visual Intelligence‌, you may see a tappable bubble at the top of the viewfinder that lets you know what you're looking at. Simply tap it to view more information. If the output is incorrect, you can use the thumbs up and thumbs down icons below the card to submit feedback to Apple.

Article Link: iOS 18.3: Use New Visual Intelligence Features on iPhone 16

Probably a dumb question, but..

So, is "Apple Intelligence" an "all-or-nothing" feature, in that there's no way to use local features "Apple Intelligence" and have ChatGPT turned off entirely? Or?

I've yet to see any clearly worded explanation re: that..

So, I'm thinking it is an "all-or-nothing" thing..

Which will be disappointing.
 
Like I keep saying, just buy Apple stock (AAPL) then you will be happy it's only on NEW models. :) :)
we're like 80% in to the Apple Intelligence rollout - can anyone honestly tell me 1 good benefit? The big downside, the massively decreased battery life is a tangible downside. I sure hope the contextual siri actually works.

None of that is creating any upward pressure on the company's valuation.
 
I find it hard to believe they're not going to give this to iPads (maybe even Macs) that don't have the Camera Control eventually. Perhaps in iOS 19.
 
Probably a dumb question, but..

So, is "Apple Intelligence" an "all-or-nothing" feature, in that there's no way to use local features "Apple Intelligence" and have ChatGPT turned off entirely? Or?

I've yet to see any clearly worded explanation re: that..

So, I'm thinking it is an "all-or-nothing" thing..

Which will be disappointing.
Nope, you can turn off ChatGPT off while leaving everything else on. Under Apple Intelligence Settings there is an "Extensions" section which (currently) only has ChatGPT in it. When you click into that sub-menu, there's a toggle for "Use ChatGPT".
 
  • Like
Reactions: jwdsail
Meh. Couple of features I will try for the novelty of it then never use again. A friend told me they already have this type of stuff with their Android and google lens or some such thing?
 
we're like 80% in to the Apple Intelligence rollout - can anyone honestly tell me 1 good benefit? The big downside, the massively decreased battery life is a tangible downside. I sure hope the contextual siri actually works.

None of that is creating any upward pressure on the company's valuation.
I’m enjoying using Proofread on large chunks of text. It’s super useful.
 
Nope, you can turn off ChatGPT off while leaving everything else on. Under Apple Intelligence Settings there is an "Extensions" section which (currently) only has ChatGPT in it. When you click into that sub-menu, there's a toggle for "Use ChatGPT".
Ah, great news. Thanks
 
  • Like
Reactions: surferfb
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.