HomePod Firmware Details iPhone 'SmartCamera' Feature for Autodetecting Pets, Babies, and Scenes

MacRumors

macrumors bot
Original poster
Apr 12, 2001
49,955
11,233



The HomePod firmware Apple released early continues to offer up insight into future software and hardware capabilities for the HomePod, iPhone 8, and other devices, with the newest discovery coming today developer from Guilherme Rambo.

He's unearthed a new "SmartCamera" feature, which appears to be something that will be built into future iPhones and/or iOS 11, perhaps taking advantage of the new facial recognition software that we expect to see in the iPhone 8.

The firmware suggests the camera app will be able to detect different types of scenes, photo conditions, and photography subjects like pets and children. Several scenes are referenced, including Fireworks, Foliage, Pet, BrightStage, Sport, Sky, Snow, and Sunset/Sunrise, indicating the iPhone's camera may be able to detect a scene and then set the ideal exposure, shutter speed, and other factors to take the best photograph.


Many cameras, from point and shoot models to DSLRs, have a range of scene presets that can be selected, and it looks like Apple's planning to implement something similar.

There are also specific references to a "freezeMotion" feature that mentions face scenes, pets, and babies, perhaps pointing towards new scene detection functionality that can recognize a fast moving target and automatically capture a photo at an ideal moment.


A third screenshot covers several "Confidence" metrics and hints at the camera's ability to recognize not just pets and babies, but documents and QR codes. Both document scanning and QR code scanning with the camera are built into iOS 11, so at least some of these features will be available for all iPhone models. It's not entirely clear, however, what will require the facial recognition hardware rumored for the iPhone 8 and what will be available for other devices.


Existing iPhones running the current version of iOS already include object recognition functionality, but it's limited to the Photos app right now. The Photos app uses AI to detect objects and people in photos for smart search and organization, and it seems some of that technology could be making its way to the Camera app going forward.

The HomePod firmware contains hints about future iOS 11 functionality and the iPhone 8 because the HomePod runs a full version of iOS. The current version of iOS 11 in testing has been stripped of references to unreleased features, but Apple neglected to make the same edits to the HomePod firmware, allowing enterprising developers to dig up the company's secrets.

Apple has accidentally leaked the general design of the iPhone 8, confirmed that it has an infrared facial tracking mechanism, and given us hints of several upcoming features like a split status bar at the top and a tap to wake feature. It also seemingly confirms both a virtual Home button and function area along with the absence of an under-display Touch ID solution.

Article Link: HomePod Firmware Details iPhone 'SmartCamera' Feature for Autodetecting Pets, Babies, and Scenes
 

agwin27

macrumors member
Jul 30, 2014
30
27



The HomePod firmware Apple released early continues to offer up insight into future software and hardware capabilities for the HomePod, iPhone 8, and other devices, with the newest discovery coming today developer from Guilherme Rambo.

He's unearthed a new "SmartCamera" feature, which appears to be something that will be built into future iPhones and/or iOS 11, perhaps taking advantage of the new facial recognition software that we expect to see in the iPhone 8.

The firmware suggests the camera app will be able to detect different types of scenes, photo conditions, and photography subjects like pets and children. Several scenes are referenced, including Fireworks, Foliage, Pet, BrightStage, Sport, Sky, Snow, and Sunset/Sunrise, indicating the iPhone's camera may be able to detect a scene and then set the ideal exposure, shutter speed, and other factors to take the best photograph.


Many cameras, from point and shoot models to DSLRs, have a range of scene presets that can be selected, and it looks like Apple's planning to implement something similar.

There are also specific references to a "freezeMotion" feature that mentions face scenes, pets, and babies, perhaps pointing towards new scene detection functionality that can recognize a fast moving target and automatically capture a photo at an ideal moment.


A third screenshot covers several "Confidence" metrics and hints at the camera's ability to recognize not just pets and babies, but documents and QR codes. Both document scanning and QR code scanning with the camera are built into iOS 11, so at least some of these features will be available for all iPhone models. It's not entirely clear, however, what will require the facial recognition hardware rumored for the iPhone 8 and what will be available for other devices.


Existing iPhones running the current version of iOS already include object recognition functionality, but it's limited to the Photos app right now. The Photos app uses AI to detect objects and people in photos for smart search and organization, and it seems some of that technology could be making its way to the Camera app going forward.

The HomePod firmware contains hints about future iOS 11 functionality and the iPhone 8 because the HomePod runs a full version of iOS. The current version of iOS 11 in testing has been stripped of references to unreleased features, but Apple neglected to make the same edits to the HomePod firmware, allowing enterprising developers to dig up the company's secrets.

Apple has accidentally leaked the general design of the iPhone 8, confirmed that it has an infrared facial tracking mechanism, and given us hints of several upcoming features like a split status bar at the top and a tap to wake feature. It also seemingly confirms both a virtual Home button and function area along with the absence of an under-display Touch ID solution.

Article Link: HomePod Firmware Details iPhone 'SmartCamera' Feature for Autodetecting Pets, Babies, and Scenes
Whoever worked on the HomePod firmware is gonna get fired lol.
 
  • Like
Reactions: Avieshek

citrusui

macrumors newbie
Jul 31, 2017
2
1
Virginia, USA
It was very clearly a mistake. The file still “downloads”, but has now been obfuscated. The .zip file no longer opens properly.
 

AngerDanger

macrumors 601
Dec 9, 2008
4,890
23,489
How is this oS revealing so many things, whats different than other OS apple makes, did someone make a mistake and published un-encrypted part of code or something ?
In the very article you're commenting on:
The HomePod firmware contains hints about future iOS 11 functionality and the iPhone 8 because the HomePod runs a full version of iOS. The current version of iOS 11 in testing has been stripped of references to unreleased features, but Apple neglected to make the same edits to the HomePod firmware, allowing enterprising developers to dig up the company's secrets.
 

LV426

macrumors 65816
Jan 22, 2013
1,010
506
I find it hard to believe that Touch ID would be removed completely. The reason being that hundreds of banks have signed agreements with Apple to support Apple Pay, and part of that is to have payments authenticated by a fingerprint. Imagine what would happen if some major bank had facial recognition foisted upon it, and they didn't agree to it. All hell would break loose.
 

WBRacing

macrumors 65816
Nov 19, 2012
1,265
2,836
UK
The gift that just keeps giving. Someone made a huge mistake at apple...
It was very clearly a mistake. The file still “downloads”, but has now been obfuscated. The .zip file no longer opens properly.
Don't you believe it. I used to work at the R&D site of a major car manufacturer. I was in a meeting with two very senior people when a person popped in to tell them that some photographers were hiding in the bushes, outside the perimeter fence by the exit ramp. They immediately ok'd it for 2 camo-covered cars to be driven out.

Playing the media game is smart business.
 

outskirtsofinfinity

macrumors 6502
Aug 2, 2017
256
769
Calgary
Was the Firmware Update in question immediately pulled from Apple servers, or is it still there? It's already in the wild, of course, so pulling it would only serve to inform the world that it was unintentional (and thus a major embarrassment), as opposed to a calculated publicity stunt (and thus an excellent idea).
 

gstevie

macrumors 6502
Jul 12, 2009
361
80
Glasgow
This may have been answered, if so apologies. Why does the HomePod firmware have all this information / detail on the next iPhone? Why would fundamental code only for an iPhone be needed in the HomePod's code?
 
  • Like
Reactions: netsped

Dilster3k

macrumors 6502a
Jul 20, 2014
790
3,205
Doubt it was intentional, lots of folks over at Cupertino must be not too happy about this. Schiller said it himself, they much rather have the momentum take place on stage during announcement. Guess some interns over there are having a hectic week.:D
 

Relentless Power

macrumors Nehalem
Jul 12, 2016
34,327
35,407
Doubt it was intentional, lots of folks over at Cupertino must be not too happy about this.
Perhaps. Being a cynic here, But I question the timing of all this leaked information. It's literally six weeks before the Keynote and all of this code is now being leaked inadvertently? It just seems suspicious to me.
 
  • Like
Reactions: GrumpyMom

Chupa Chupa

macrumors G5
Jul 16, 2002
14,834
7,394
The firmware suggests the camera app will be able to detect different types of scenes...indicating the iPhone's camera may be able to detect a scene and then set the ideal exposure, shutter speed, and other factors to take the best photograph.
AND when you start making out on the sofa Apple Music will automatically start up a Marvin Gaye set list. I mean talk about scene detection.
 

Shawn Parr

macrumors regular
Oct 31, 2008
191
97
I find it hard to believe that Touch ID would be removed completely. The reason being that hundreds of banks have signed agreements with Apple to support Apple Pay, and part of that is to have payments authenticated by a fingerprint. Imagine what would happen if some major bank had facial recognition foisted upon it, and they didn't agree to it. All hell would break loose.
You can use Apple Pay on Apple Watch without Touch ID. You can also use it on phones with only a passcode. The banks agreements with Apple on Apple Pay are around the implementation of tokenization, not specific authentication systems on the end device.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.