Photos Memories AI Results

Discussion in 'iOS 10' started by Feenician, Jun 14, 2016.

  1. Feenician Suspended

    Feenician

    Joined:
    Jun 13, 2016
    #1
    So I'm surprised how little discussion I've seen on this feature so I thought I'd post a thread to get people's impressions. I'm quite impressed. I have 750+ photos and the AI has done a pretty good job pulling things out where they're the main focus of a picture.

    Hits: it has successfully pulled out things like "cat" (with a couple of exceptions I'll note), "sports field", "tree", "palm tree", "woodlands", "waterways", "car" (even managing to separate sedan, suv etc.)

    Misses: There are a few odd misses I've noticed. I was typing "po" for ""pool" (which the AI did very well with btw) and I noticed there was a classification for "pooches". These were actually both cat pics, though both had been recently shaved in a "Lion cut" style so perhaps were mistaken for poodles.
    A couple of odd things too that I can sort of see the logic if I squint. Like I have a pic of some jerky in a white wrapper which is identified as ice cream. I guess if you squint it looks like vanilla with chocolate topping.
    The other "crime" is incompleteness. An odd shaped pool left out, an unusual dragster car not identified etc.

    All in all shaping up well for a first pass I think.

    Post your best/worst/funniest matches.
     
  2. macrescue911 macrumors newbie

    Joined:
    Jun 14, 2016
    Location:
    Florida, USA
    #2
    Thanks Feenician for these observations. That is indeed very interesting.
    Unfortunately, I'm not a developer and can't test by myself.
    I was wondering if the face detection syncs in anyway with the faces that are already detected in the Photos app on the mac? If you match any faces in iOS, are they available on the mac?
    Also, is there any functionality in the iOS app to view additional information of the pictures (Date, Time, Comments, EXIF...)?
     
  3. Polaroid macrumors 6502a

    Joined:
    Oct 1, 2013
  4. deadworlds macrumors 6502

    deadworlds

    Joined:
    Jun 15, 2007
    Location:
    Citrus Heights,CA
    #4
    This is a feature I had completely forgotten about. After reading your post I went ahead and did some quick searched. Over all I am impressed, it was able to pick out bowling picture, beaches, trees, and even fish. Something that was interesting and sort of funny, when the search field is selected and nothing is entered it gives suggested searches at the bottom. One of the categories was called "Show me photos of Barbara Streisand", which then took me to photos of my anemone.
     

    Attached Files:

  5. Superhai macrumors regular

    Superhai

    Joined:
    Apr 21, 2010
    #5
    I smell future unintentional categorization controversies in the future.
     
  6. dannyyankou macrumors 603

    dannyyankou

    Joined:
    Mar 2, 2012
    #6
    Wow, it created a movie from my family's trip to San Juan and I'm extremely impressed. I imagine this feature will be very popular and Apple will market it a lot.
     
  7. deadworlds macrumors 6502

    deadworlds

    Joined:
    Jun 15, 2007
    Location:
    Citrus Heights,CA
    #7
    I have been very impressed by the memory feature. I rediscovered some photos of a trip I took to LA a few years ago. When watching this feature on the keynote I was uninterested, but watching it being done with my own photos really made a difference. I think this a great idea and a great way to also share a short video of your trips with family and friends. All without the need to manually edit them in iMovie.
     
  8. dannyyankou macrumors 603

    dannyyankou

    Joined:
    Mar 2, 2012
    #8
    I love how it mixes in videos also. It adds a nice touch.
     
  9. Hugo Frade, Jun 14, 2016
    Last edited: Jun 14, 2016

    Hugo Frade macrumors newbie

    Joined:
    Jun 2, 2015
    Location:
    Portugal
    #9
    Hi! Can anyone tell me or check if faces in photos sync between idevices and macs?
    Thank you :D
     
  10. Superhai macrumors regular

    Superhai

    Joined:
    Apr 21, 2010
    #10
    I tried it on the macOS app and it just failed after some time, but on the iOS app it found no memories, but that is understandable as I have just a few pictures there.
     
  11. Feenician thread starter Suspended

    Feenician

    Joined:
    Jun 13, 2016
    #11
    On the faces piece, yep, it seems to have imported that metadata from OS X photos right off the bat - I guess it was in iCloud all along. It also has further opportunities to add and refine it right on iOS.

    The metadata piece is more complex. It definitely has date and you can search on that and view it, along with (basic) geo information. Metadata (i used camera model to test) doesn't seem searchable - not yet at least.

    Seems to. At least in the Mac -> iOS direction. I'll test the other direction but I guess it may require an update to macOS/Photos.

    lol it definitely has a few false reads. All AI photo recognition does but it could stand some improvement and I hope we see that over the coming betas

    I do have mixed feelings about the "all on device" processing and the seeming lack of ways to train it and say "no, that's not a cat, that's my tie/dog/ferret" as I'm not sure how Apple will be able to improve the model if they aren't crowdsourcing the data, Google style. Of course that permissiveness with your private info to the cloud has it's own trade-offs which I think many here understand. Let's not start the usual holy war.

    Concerns aside 't's pretty impressive just how smart it is now. It's a great start and a nifty feature. Cautiously optimistic :)
     
  12. Hugo Frade macrumors newbie

    Joined:
    Jun 2, 2015
    Location:
    Portugal
    #12
    Thank you :) I know that with iOS 9 if I search a face it would show me the photos with that query. It's nice to hear that now they do the full job and show them in an album :)
     
  13. macrescue911 macrumors newbie

    Joined:
    Jun 14, 2016
    Location:
    Florida, USA
    #13
    Thanks for your response! Is there the possibility to manually edit/delete any recognized items?
     
  14. Feenician thread starter Suspended

    Feenician

    Joined:
    Jun 13, 2016
    #14
    I don't see any way to update any metadata, other than faces by the usual mechanism. Metadata isn't directly exposed for the most part and I doubt it will be. Probably still looking at 3rd party apps for the nitty gritty stuff
     
  15. Paco II macrumors 65816

    Joined:
    Sep 13, 2009
    #15
    Can anyone comment how it compares to Google Photos?
     
  16. schlaufox macrumors regular

    Joined:
    Jun 18, 2013
    #16
    I'm having a lot of trouble getting anywhere with the facial recognition. The progress bar for the creation of the People albums gets stuck very early on, and the phone heats up a lot. Anyone else experiencing this?
     
  17. irishv macrumors regular

    Joined:
    Oct 27, 2008
    #17
    That's unfortunate. I still cannot understand how Apple hasn't given us the ability to caption and keyword photos in iOS. That should have been available for the first iPad. Looks like Photos will still fail as a DAM, which is a shame given the advantages of having your full library on all devices.
     
  18. AustinIllini macrumors demi-god

    AustinIllini

    Joined:
    Oct 20, 2011
    Location:
    Austin, USA
    #18
    It's theoretically more private.

    That being said, it's still a matter of the "airplane question". If I get on an airplane and disable all radios, does the recognition still work?

    Does it affect battery life? What about photos in the cloud?
     
  19. Paco II macrumors 65816

    Joined:
    Sep 13, 2009
    #19
    Actually referring to how good the AI is in 'knowing' what's in a photo and making that searchable.

     
  20. AustinIllini macrumors demi-god

    AustinIllini

    Joined:
    Oct 20, 2011
    Location:
    Austin, USA
    #20
    I know. I was just suggesting another important question. The reality is, it's likely the same, but the mechanism is hugely important here.
     
  21. Feenician thread starter Suspended

    Feenician

    Joined:
    Jun 13, 2016
    #21
    I really thought there'd be more discussion on this. People must have all sorts of photos that'd be interesting to see if and how they're classified by Apple's AI.

    Instead I guess it'll be 30 page whinge threads crying about an extra swipe in a dev beta
     
  22. vertsix macrumors 65816

    vertsix

    Joined:
    Aug 12, 2015
    #22
    AI?

    Don't you mean...

    image.jpeg


    A D V A N C E D
    C O M P U T E R
    V I S I O N ?
     
  23. shk718, Jun 21, 2016
    Last edited: Jun 21, 2016

    shk718 macrumors 65816

    Joined:
    Jun 26, 2007
    #23
    I'm sure Barbara would love that - LOL!!!!!
    --- Post Merged, Jun 21, 2016 ---
    I just downloaded google photos to my iphone 6s to see how well it does with recognition - it makes a ton of mistakes - it grouped some vegas pictures together with Greece and labeled it Paradise, missed a ton of pictures from other areas. The facial recognition was pretty good - but again - made mistakes. And, I'm not going to mention what it thinks a birthday is - maybe it's confusing it with birthday suite. I'm sure when OS 10 goes mainstream we're gonna hear all kinds of complaints and the google fanatics will come to this sight and say how much better a job google does - well I can see for myself it has flaws as I'm sure apples version will as well.
    --- Post Merged, Jun 21, 2016 ---
    I don't see a way to edit the metadata in google photos for iphone either - this will be very important - they also need a way to segregate any porn we may have from non porn albums. I'm getting some scandalous results!!!
     
  24. Feenician, Jun 21, 2016
    Last edited: Jun 21, 2016

    Feenician thread starter Suspended

    Feenician

    Joined:
    Jun 13, 2016
    #24
    Yes we will and it'll be based on the usual sound reasoning like "Google identified this one photo and Apple didn't!! Apple sucks!! Tim Cook. Steve Jobs. Scott Forstall etc etc."
     
  25. GreyOS macrumors 68030

    GreyOS

    Joined:
    Apr 12, 2012
    #25
    Photos created a category 'dinosaur' for a photo of a dinosaur costume I made for a party a couple years ago. Well done Apple.
     

Share This Page