Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

MacRumors

macrumors bot
Original poster
Apr 12, 2001
63,537
30,844



Apple has been awarded a patent by the U.S. Patent and Trademark Office (via AppleInsider) for a system that allows for a personal computing device such as a Mac or iPhone to be controlled through facial detection and recognition, primarily for security and convenience purposes.

The patent, which was filed back in 2008, introduces itself by describing the problem with the interaction between users and current electronics, stating that devices such as computers inconvenience the user by requiring action in order to continue operating without interruption, along with detailing the security hazard that comes with the inability of passwords to detect a truly authorized user.

apple_face_detection_flow.jpg
The facial recognition and detection system is broken up into three separate parts, and includes a face detection decision application, a face recognition application, and an input/output control manager, all working with an image sensor to determine whether a user is authorized to control a device.
In a further aspect, a personal media device includes an image sensor that captures one or more images. The device includes a data store having at least one known face pattern that is associated with an authorized user of the media device. The device includes a processor that detects one or more faces in the captured images, recognizes at least one of faces as the face of the authorized user by comparing the one or faces with the data store, and controlling the operation of an application of the device in response to recognizing at least one of the faces as the face of the authorized user.
An incoming phone call is cited as an example scenario that could benefit from a facial recognition and detection system, with the system keeping the screen off and only giving off a ringtone or vibration alert if a user is not authorized compared to displaying a normal call screen for an authorized user. The same principle is applied to an incoming email, where a message can be hidden if an unauthorized user is detected.

The patent also details a number of examples as to what information the facial detection and recognition system cites in authorizing users, with information such as visual facial features and background being matched up against stored information to determine whether control of a device can be accessed or not.

It is unknown exactly how or even whether Apple plans to utilize this technology in its products, but competitors such as Samsung and Google have already touted simple facial recognition as key features in their products. Apple also recently completed its acquisition of 3D body sensing firm PrimeSense, and while the system detailed in the patent differs from the firm's image sensing technology, both could be used as part of a bigger initiative by Apple to better integrate human recognition into its products.

This is also not the first time evidence of Apple's interest in face recognition has surfaced, with other patent applications addressing similar concepts while the company acquired Swedish face recognition firm Polar Rose back in 2010.

Article Link: Apple Awarded Patent Detailing Facial Detection and Recognition System for Devices
 

BJMRamage

macrumors 68030
Oct 2, 2007
2,713
1,233
wow, weird.. our phones will know more about us than other people will
 

ArtOfWarfare

macrumors G3
Nov 26, 2007
9,560
6,059
A 2D face sensor can easily be defeated with a printed picture of the authorized face.

Doing this in 3D would be interesting (then you need a very convincing mask or something to fool it...), but that's not what was patented here. Interesting the patent took so long (and was granted! It's so obvious / unoriginal / so many people have already done it, what on earth is there left to patent?)
 

Serban

Suspended
Jan 8, 2013
5,159
928
so im guessing if samsung sgs5 will have retina sensor to unlock the phone will be facing another law suit?
 

Some guy

macrumors member
Apr 12, 2013
63
1
I remember someone asking how an iPad with support for multiple users would handle lock screen notifications (among other problems with multiple users)…

:)
 

Rogifan

macrumors Penryn
Nov 14, 2011
24,142
31,195
This patent was first filed in 2008. Who knows what Apple will do with it.
 

tuxon86

macrumors 65816
May 22, 2012
1,321
477
Well, now the NSA will have confirmation of who is really using the device they are spying on for sure...
 

TheHateMachine

macrumors 6502a
Sep 18, 2012
846
1,354
A 2D face sensor can easily be defeated with a printed picture of the authorized face.

Doing this in 3D would be interesting (then you need a very convincing mask or something to fool it...), but that's not what was patented here. Interesting the patent took so long (and was granted! It's so obvious / unoriginal / so many people have already done it, what on earth is there left to patent?)

The face unlock on Android can be setup to require a blink and/or a voice and thus printed pictures are defeated.
 

liavman

macrumors 6502
Sep 22, 2009
462
0
I had a Lenova PC from Vista days that had this feature for logging in. I hope they get sued by Apple. Not for any patent infringement, but for the horrible implementation of it. Yikes, I turned that off on day 1.
 

NMBob

macrumors 68000
Sep 18, 2007
1,914
2,458
New Mexico
I hope this feature needs to permanently connect to Apples Servers to work and will offer a direct upload to the NSA or else it wouldn't make sense.

I think we're OK. Note items 420 and 422. Same number of digits as letters in NSA and FBI.
 

NMBob

macrumors 68000
Sep 18, 2007
1,914
2,458
New Mexico
I remember someone asking how an iPad with support for multiple users would handle lock screen notifications (among other problems with multiple users)…

:)

I was semi-forced over the weekend to sit through many Android ads on TV during the ball games. The one where the whole family can share one Galaxy 10.1(?) tablet, and take notes while Facetime-like talking with someone did not go unnoticed. I don't have any use for the multiple-user thing, but being able to do multiple things at the same time like the combinations they had in the ad were not bad ideas. Too bad Apple worries more about the design of icons.
 

waldobushman

macrumors regular
Mar 3, 2011
110
0
iPhoto has had some face recognition for some time. Obviously, face recognition can be useful for more than security on mobile devices.
 

perealb

macrumors 6502
Oct 30, 2009
256
10
I hope this feature needs to permanently connect to Apples Servers to work and will offer a direct upload to the NSA or else it wouldn't make sense.
There are a lot more applications to face recognition than conspiracy theories and NSA paranoia. It would extend beyond fingerprint detection; the iPhone would know its owner (or owners!) and only do certain things if the right person is using the iPhone. Face detection together with 3D live image detection have so many applications... Besides that, like someone already mentioned, it would open iOS devices to seamlessly allow multi-user features.
 

8281

macrumors 6502
Dec 15, 2010
495
631
Soooo...facial recognition research, but we still can't run two apps at the same time on an iPad.
 

polterbyte

macrumors 6502
Sep 24, 2012
353
538
Brazil
A 2D face sensor can easily be defeated with a printed picture of the authorized face.

Doing this in 3D would be interesting (then you need a very convincing mask or something to fool it...), but that's not what was patented here. Interesting the patent took so long (and was granted! It's so obvious / unoriginal / so many people have already done it, what on earth is there left to patent?)

2D face sensors have been obsolete for over five years. The simplest, most inaccurate technologies nowadays can spot and reject photos. This is a non-issue, and I'm sure Apple has been developing much better technology since they started dwelling in face recognition.

----------

Soooo...facial recognition research, but we still can't run two apps at the same time on an iPad.

Yes, and that has been reflecting in poorer and poorer sales for the iPad since, oh, let's see, never.
 

perealb

macrumors 6502
Oct 30, 2009
256
10
Soooo...facial recognition research, but we still can't run two apps at the same time on an iPad.
iOS devices can run multiple apps at the same time but I agree its UI can be improved. You are probably talking about having multiple "windows" on the same screen where each "window" run a different application. I suppose this doesn't attract enough people for Apple to consider implementing - it seems not such a user-friendly feature for most people. If it gets too complicate, Apple will not implement it in a mobile device. If they come up with an easy UI for that, I'm sure they will release it. When I had my iPad jailbroken, I had a tweak installed called Quasar. It did exactly that but it worked just like Windows. I'm sure some people liked it but it wasn't implemented for mobile use. The windows content became too small... I rarely used it.
 

Liquorpuki

macrumors 68020
Jun 18, 2009
2,286
8
City of Angels
A 2D face sensor can easily be defeated with a printed picture of the authorized face.

Doing this in 3D would be interesting (then you need a very convincing mask or something to fool it...), but that's not what was patented here. Interesting the patent took so long (and was granted! It's so obvious / unoriginal / so many people have already done it, what on earth is there left to patent?)

That Primesense acquisition might be for 3D scanning
 

iOrbit

macrumors 6502a
Mar 8, 2012
569
30
what comes to mind when i read this is PrimeSense technologies being used as equivalents to TouchID but for iMacs /MacBooks.
 

BeyondtheTech

macrumors 68020
Jun 20, 2007
2,146
715
How much do you want to bet it won't make it into any current iOS devices? They'll probably declare that it requires a new chip or feature. I like how the iPad mini 1 is basically the iPad 2, but they've put in features on the mini that are left out on the iPad 2.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.