Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

MacRumors

macrumors bot
Original poster
Apr 12, 2001
68,701
39,618



The Photos app in iOS 10 has been updated with what Apple calls "Siri intelligence," which essentially equates to new deep learning techniques and advanced facial and object recognition algorithms.

Using these tools, Photos is able to scan a user's entire photo library, intelligently detecting people, animals, places, and objects and grouping photos together in a logical way based on those parameters. As can be seen in the video below, this enables powerful searching capabilities, allowing users to search for "cats" to bring up their images of cats, or "mountains" to find all images taken of mountains.


New to Photos on iOS is a "People" album, housing all of a user's images featuring people, grouped based on facial recognition, and there's a world map that shows the physical location where each of a user's photos were taken.

Perhaps the best new feature in Photos is a "Memories" tab that uses all of the image recognition, date, and location information to aggregate photos based around certain days, vacation trips, family events, and more, so your photos can be revisited on a regular basis. With Memories, there are options to watch quick video montages of photos, which are set to music.

Also new in the iOS 10 Photos app are Live Filters that work with Live Photos and new Markup tools for annotating photos.

The new features in Photos are powered by a device's GPU with all learning done on a device-by-device basis to ensure full privacy. Apple has made it clear that it does not see images or image metadata. When using the new Photos features, each device with a photo library will need to scan images independently -- there is no iCloud link yet.

In case you missed them, make sure to check out our seven minute WWDC 2016 video, which features a quick rundown on all of the new iOS, macOS Sierra, tvOS, and watchOS features Apple introduced this week, and our video highlighting iOS 10's overhauled Lock screen. stay tuned to MacRumors for more in-depth software videos.

Article Link: See iOS 10's New Photos App in Action
 
  • Like
Reactions: superproxy
I tried it with the "Best of 3 months" setting. Played my trip to PHX, my puppies, family pics, nudes, screenshots of conversations on Tinder, and some food and memes. Not exactly what I was expecting for my friends to see lol.
 
super excited about this. Google's version works very well. I'm curious how much they can extract - will it know that Disney park characters aren't friends of mine? I also wonder what it will do with porn. will there be a porn folder?? ;) I also bet the first few days will be a major battery drain as the phone tries to index everything. currently, when I get a new phone, I notice the first few days are wonky. this is adding billions of calculations that need to be made. it still amazes me that they can take a file of 1's and 0's and figure out that its a bridge. Awesome stuff!!!
 
I've been disappointed by features like this in the past. I'd rather make a video myself. But I'll give it a try in the public beta and see if it works for me. If it makes it easier for me to find a picture of the Treaty Oak that I took in 1987 without my having to add metadata manually, I'll use it as much as its usefulness deserves.
 
  • Like
Reactions: ThunderSkunk
Is it just me, or do these features seem like Apple is trying to play catch-up with Google Photos? I remember trying the Google Photos app for the first time and I was blown away by the search. If this can do a better job, I will be very excited.
 
  • Like
Reactions: pechar and dk001
That demo is actually fairly impressive for a first version app from a company that doesn't have billions of user photos that they can scan and pull data from like Google or FaceBook. So can someone tell me if you can tag photos in the app to help improve things locally? And in the demo it looked as though there may have been duplicates of the girl—can those be merged easily as one person? I'm really excited about this technology as I have well over ten-thousand photos and videos combined—and it's only getting worse as I have kids!
 
super excited about this. Google's version works very well. I'm curious how much they can extract - will it know that Disney park characters aren't friends of mine? I also wonder what it will do with porn. will there be a porn folder?? ;) I also bet the first few days will be a major battery drain as the phone tries to index everything. currently, when I get a new phone, I notice the first few days are wonky. this is adding billions of calculations that need to be made. it still amazes me that they can take a file of 1's and 0's and figure out that its a bridge. Awesome stuff!!!

It made me one of Magic Kingdom June 2013 that is really cool. It seems to only do a few a day, So far I only have two days worth, three per day.
 
Is it just me, or do these features seem like Apple is trying to play catch-up with Google Photos? I remember trying the Google Photos app for the first time and I was blown away by the search. If this can do a better job, I will be very excited.

Looks like Apple is going full force with data mining.

The difference between what Apple is doing and Google is doing is device vs cloud. So they aren't really data mining per se.
 
super excited about this. Google's version works very well. I'm curious how much they can extract - will it know that Disney park characters aren't friends of mine? I also wonder what it will do with porn. will there be a porn folder?? ;) I also bet the first few days will be a major battery drain as the phone tries to index everything. currently, when I get a new phone, I notice the first few days are wonky. this is adding billions of calculations that need to be made. it still amazes me that they can take a file of 1's and 0's and figure out that its a bridge. Awesome stuff!!!
I remember using Google Goggles in the aughts and being amazed that I could feed it a picture of a particular house (a not-very-famous landmark), and it could recognize exactly which house it was and show me other pictures of the same house (along with some pictures that definitely were of other things).

What's cool about Apple's "invention" is that the recognition is happening in the phone itself, not some massive server.
 
It made me one of Magic Kingdom June 2013 that is really cool. It seems to only do a few a day, So far I only have two days worth, three per day.
Awesome - what is the most unusual object you've seen it tag or what kinds of objects do you see it taging? I also wonder if those tags will be shared with photos on the mac - meaning do the tags get attached to the picture in iCloud (I so hope so).
 
I remember using Google Goggles in the aughts and being amazed that I could feed it a picture of a particular house (a not-very-famous landmark), and it could recognize exactly which house it was and show me other pictures of the same house (along with some pictures that definitely were of other things).

What's cool about Apple's "invention" is that the recognition is happening in the phone itself, not some massive server.
Apple's maps has tons of landmarks on it - I wonder if it will identify them - i though the co that made the tec apple bought said they didn't rely on a huge external database for identification.
 
Of the several things they're blatantly ripping off of Google's platforms, this and the Apple Watch app dock are the ones that are of the most interest to me. I pretty much shut off the Apple iCloud photo backup after I played around with Google Photos for a bit and realized how much better it was. The auto-tagging/searchability of photos is a killer feature. Perhaps this will win me back to using iCloud.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.