Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

MacRumors

macrumors bot
Original poster
Apr 12, 2001
63,489
30,727



Looking over a nearby person's shoulder is a common technique used to steal a PIN code for a device that is targeted for imminent theft. But as reported by Wired, a research team from the University of Massachusetts Lowell has taken this shoulder surfing trick to a whole new level by increasing the working distance and automating the process using Google Glass and other similar camera-equipped, mobile products.

The UMass Lowell researchers improved passcode theft by analyzing video captured from wearable and mobile devices such as Google Glass, the Samsung Gear smartwatch and the iPhone. The system anlyzes the incoming video using a custom video recognition algorithm that detects the shadows from finger taps and uses that information to predict PINs codes. Unlike the standard over-the-shoulder method that requires a direct view of the target device's display, the UMass method also can be employed at an indirect angle, allowing someone to steal a password while standing at your side.

google-glass-pin-spying.jpg
UMass researchers capturing PIN codes using Google Glass
(Image from Cyber Forensics Laboratory at University of Massachusetts Lowell)
The system is surprisingly accurate -- allowing a malicious user to capture PIN codes inconspicuously with at least 83 percent accuracy from a distance as far as three meters. This accuracy was improved to more than 90 percent when a sharper camera such as the iPhone was used or manual error correction by the researchers was added to the video analysis.
"I think of this as a kind of alert about Google Glass, smartwatches, all these devices," says Xinwen Fu, a computer science professor at UMass Lowell who plans to present the findings with his students at the Black Hat security conference in August. "If someone can take a video of you typing on the screen, you lose everything."
The researchers didn't test longer passwords, but believe they could reach an accuracy rate of 78 percent when stealing an 8-digit password from a device such as the iPad. If you are concerned about password hacking, your best line of defense is to cover your display as you type or when possible do away with a PIN code entirely such as by using the Touch ID fingerprint in the iPhone 5s.

With the results of this study, the researchers hope to convince mobile operating system companies to improve the security of their PIN input screens by taking steps such as randomizing the layout of the keypad.

Apple's Touch ID fingerprint authentication is of course another alternative to traditional passcodes. The feature launched on the iPhone 5s last year and is expected to make its way to the iPad and iPad mini later this year. Aside from increased security compared to passcodes, Touch ID has also increased usage of security features, with Apple noting during its WWDC presentation earlier this month that passcode/Touch ID usage has risen to 83% on the iPhone 5s, up from just 49% passcode usage previously.

Article Link: Demo of iPad Passcode Theft via Google Glass Highlights Benefits of Touch ID
 

spacemanspifff

macrumors 6502
Jan 23, 2010
267
19
SPACE
Hey thief - why not try this...

Couldn't these researchers be doing something more worthwhile with their time? I can't see any value in them proving that they can do this kind of thing other than highlighting the possibility of this to would be thieves.

At least Apple is a step ahead of these people with Touch ID.
 

AngerDanger

Graphics
Staff member
Dec 9, 2008
5,452
29,002
Google presents the thief of tomorrow! And boy is he ever angsty about his social ineptitude…

blogger-image--1656245690.jpg
 
Last edited:

2010mini

macrumors 601
Jun 19, 2013
4,698
4,806
Couldn't these researchers be doing something more worthwhile with their time? I can't see any value in them proving that they can do this kind of thing other than highlighting the possibility of this to would be thieves.

At least Apple is a step ahead of these people with Touch ID.

Highlighting security flaws is always a good thing. It helps manufactures and consumers be more aware.
 

Reason077

macrumors 68040
Aug 14, 2007
3,605
3,643
Better headline:

"Google demonstrates nefarious device that enables hackers and criminals to steal your personal data."
 

Yakibomb

macrumors 6502
May 13, 2014
413
60
Cape Town
Couldn't these researchers be doing something more worthwhile with their time? I can't see any value in them proving that they can do this kind of thing other than highlighting the possibility of this to would be thieves.

At least Apple is a step ahead of these people with Touch ID.

I think this type of research is extremely useful. It creates greater awareness in consumers to the faults in their devices, which in turn leads to companies seeking ways to combat these flaws
 

macduke

macrumors G5
Jun 27, 2007
13,133
19,662
Randomizing the layout of the keypad for PIN entry is a great idea.

Great in theory, terrible in practice. Many people can type their passcode without even looking, or at the least very quickly because they know the sequence. If you increase the complexity, more people will opt to not use a passcode at all.

For a pure touch-based visual input method, using a gesture would probably be the hardest to for a machine to decipher from more extreme angles and distances. Otherwise Touch ID is the best choice.

I love it when Apple solves problems before they are even problems.
 

troop231

macrumors 603
Jan 20, 2010
5,822
553
Someone with Google Glass on in a public restroom is asking for trouble, even if they're not 'using' it.
 

UncleSchnitty

macrumors 6502a
Oct 26, 2007
851
14
What a terrible picture to prove a point. I think its safe to say that I would know who stole my device, and I don't pull my fingers 3 inches away with each button press while my device is on a table. hah. I get the point but if someone is starring at you while you type your password hold your device close, especially if they have their eyes closed as if to say "see Im not looking"

Also watch out for this guy:
images
 
Last edited:

Alenore

macrumors 6502
Apr 7, 2013
423
426
You mean what people used to do years ago with their cellphone camera to play prank at school? Wow.
 

John.B

macrumors 601
Jan 15, 2008
4,193
705
Holocene Epoch
Don't worry about your iOS passcodes, worry about your credit card PINs. The new chip-and-PIN standard coming to the US puts all responsibility for unauthorized purchases on the cardholder, and this underscores how easy it is for a thief to learn your PIN.
 

BenTrovato

macrumors 68040
Jun 29, 2012
3,035
2,198
Canada
Wait until Google Glass gets a little fancier.. they'll be stealing a lot more than Passwords.

Inventing something like Touch ID is mandatory unfortunately (or fortunately). Once they develop algorithms they'll be able track people. If you walk to work everyday, G Glass can pick out what people do. For example, if G Glass picks out a man who always stops at Starbucks at 850am. You know he's not home at that time. You know he's about to make a transaction. He may be on social media at that time. Lots of data, becomes a target for theft.

When normal people have access to AI algorithms, how we operate in the world will have to change. Touch ID is only the beginning.
 

doelcm82

macrumors 68040
Feb 11, 2012
3,748
2,768
Florida, USA
This would be great, but I can imagine a large number of users would opt against this as it would increase the time required to login
Randomizing the positions of the numbers is an interesting idea. But it's not a good one for the reason you stated. The biometric approach (TouchID) is a better idea.

Making it harder to unlock your device = Fewer users locking their devices.
Making it easier to unlock your device = More users locking their devices.

Also, anyone who could see your screen when it asks for your unlock code would also see the key layout. Especially since you would enter your unlock code hesitantly.
 

H2SO4

macrumors 603
Nov 4, 2008
5,651
6,937
Don't worry about your iOS passcodes, worry about your credit card PINs. The new chip-and-PIN standard coming to the US puts all responsibility for unauthorized purchases on the cardholder, and this underscores how easy it is for a thief to learn your PIN.

I made a statement about this earlier. It doesn’t seem to have been an issue at all over here in the Uk.
 

John.B

macrumors 601
Jan 15, 2008
4,193
705
Holocene Epoch
Great in theory, terrible in practice. Many people can type their passcode without even looking, or at the least very quickly because they know the sequence. If you increase the complexity, more people will opt to not use a passcode at all.

For a pure touch-based visual input method, using a gesture would probably be the hardest to for a machine to decipher from more extreme angles and distances. Otherwise Touch ID is the best choice.

The swype-style gesture unlock codes are probably the easiest for someone looking over your shoulder to remember.

IMO, Touch ID makes it easier to have a more complex passcode, because you only need to use it under certain circumstances (i.e. after a restart).
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.