Become a MacRumors Supporter for $25/year with no ads, private forums, and more!

Contractors Working on Siri 'Regularly' Hear Recordings of Drug Deals, Private Medical Info and More Claims Apple Employee

MacRumors

macrumors bot
Original poster
Apr 12, 2001
50,443
11,833



Contractors that are working on Siri regularly hear confidential medical information, drug deals, recordings of couples having sex, and other private information, according to a report from The Guardian that shares details collected from a contractor who works on one of Apple's Siri teams.

The employee who shared the info is one of many contractors around the world that listen to Siri voice data collected from customers to improve the Siri voice experience and help Siri better understand incoming commands and queries.


According to The Guardian, the employee shared the information because he or she was concerned with Apple's lack of disclosure about the human oversight, though Apple has several times in the past confirmed that this takes place and the practice has been outlined in past reports as well.
The whistleblower said: "There have been countless instances of recordings featuring private discussions between doctors and patients, business deals, seemingly criminal dealings, sexual encounters and so on. These recordings are accompanied by user data showing location, contact details, and app data."
In a statement, Apple confirmed to The Guardian that a small number of anonymized Siri requests are analyzed for the purpose of improving Siri. A small, random subset (less than 1 percent) of daily Siri activations are used for grading, with each clip only lasting for a few seconds.
"A small portion of Siri requests are analysed to improve Siri and dictation. User requests are not associated with the user's Apple ID. Siri responses are analysed in secure facilities and all reviewers are under the obligation to adhere to Apple's strict confidentiality requirements."
Apple has not made its human-based Siri analysis a secret, but its extensive privacy terms don't appear to explicitly state that Siri information is listened to by humans. The employee said that Apple should "reveal to users" that human oversight exists.

The contractor who spoke to The Guardian said that "the regularity of accidental triggers on the watch is incredibly high," and that some snippets were up to 30 seconds in length. Employees listening to Siri recordings are encouraged to report accidental activations as a technical problem, but aren't told to report about content.

Apple has an extensive privacy policy related to Siri and says it anonymizes all incoming data so that it's not linked to an Apple ID and provides no information about the user. Still, the contractor claims that user data showing location, contact details, and app data is shared, and that names and addresses are sometimes disclosed when they're spoken aloud. To be clear, Apple says that all Siri data is assigned a random identifier and does not include location or contact details as stated by the contractor.
As well as the discomfort they felt listening to such private information, the contractor said they were motivated to go public about their job because of their fears that such information could be misused. "There's not much vetting of who works there, and the amount of data that we're free to look through seems quite broad. It wouldn't be difficult to identify the person that you're listening to, especially with accidental triggers - addresses, names and so on.
While Apple's Siri privacy policy and security documents do not mention human oversight specifically, they are detailed and provide information on how Siri recordings are used.

As stated in Apple's security white paper, for example, user voice data is saved for a six-month period so that the recognition system can use them to better understand a person's voice. The voice data that's saved is identified using a random identifier that's assigned when Siri is turned on, and it is never linked to an Apple ID. After six months, a second copy is saved sans any identifier and is used by Apple for improving Siri for up to two years. A small number of recordings, transcripts, and associated data without identifying information is sometimes used by Apple for ongoing improvement of Siri beyond two years.

Apple's privacy website has a Siri section that offers up more info, explaining that all Siri queries are assigned a random identifier not associated with an Apple ID. The identifier is reset whenever Siri is turned off and then on again, and turning Siri off deletes all user data associated with a Siri identifier.
When we do send information to a server, we protect your privacy by using anonymized rotating identifiers so that searches and locations can't be traced to you personally. And you can disable Location Services, our proactive features, or the proactive features' use of your location at any time.
Those concerned about Siri triggering accidentally on devices like the iPhone, Apple Watch, and HomePod can turn off the "Hey Siri" feature and can instead activate Siri manually, and Siri can also be turned off entirely.

Article Link: Contractors Working on Siri 'Regularly' Hear Recordings of Drug Deals, Private Medical Info and More Claims Apple Employee
 
  • Like
Reactions: macfacts

ersan191

macrumors 65816
Oct 26, 2013
1,483
2,523
Apple made it pretty clear that Siri is anonymized - contractors absolutely should not be able to see "contact details" of whoever the recording is from. This would be huge if that were the case, which I find hard to believe. If names and addresses are referenced separately then what does "contact details" even entail?
 
Comment

weup togo

macrumors 6502
May 6, 2016
351
1,228
People don't understand that any record that exists can be subpoenaed. Apple's anonymization techniques leave many holes, and they can be compelled to undo them by court order. There's nothing stopping a prosecutor from subpoenaing Apple for all audio records from a particular location at a particular time to solve a crime.

We've all traded convenience for real privacy.
 
Comment

NickName99

macrumors 6502a
Nov 8, 2018
946
2,743
Sounds like they just need to improve the vetting of these contractors. Naturally some private information will end up in Siri requests sometimes.

I occasionally have access to sensitive information when I’m debugging using restored client database backups. I take it very seriously, I don’t go poking around, I delete the database when I’m done working on the issue. I treat it with the same respect I would want a fellow professional to treat my data with.
 
Comment

jclo

Editor
Staff member
Dec 7, 2012
1,675
3,356
California
Apple made it pretty clear that Siri is anonymized - contractors absolutely should not be able to see "contact details" of whoever the recording is from. This would be huge if that were the case, which I find hard to believe. If names and addresses are referenced separately then what does "contact details" even entail?

I'm also skeptical of this claim from the contractor. Apple's privacy policy is pretty clear on this point, even if it doesn't mention the human oversight. I believe names and addresses might sometimes be heard if spoken aloud, but not that info is sent with contact information/addresses/location.
 
Comment

heov

macrumors 6502
Aug 16, 2002
266
665
Lol would love to see what users defending Apple here had to say when MacRumors posted about Amazon and Google employees listening in.

So basically Apple does exactly what Amazon and Google does- listen. Whodathunk the only way to improve recognition is to have a human grade it.
 
Comment

GrumpyMom

macrumors G3
Sep 11, 2014
9,194
13,196
Home Pod gets triggered super easily. She butts into a lot of conversations in our house. I’ve never seen my watch activate accidentally but my iPhone sometimes does.

Alexa is also nosy and sometimes blurts out things that make me think a person is directly on the other end. One day I complained about not feeling well and Alexa self activated and wished me to get better soon. I was not able to trigger that reaction again. Even the first time I didn’t say anything remotely that sounded like “Alexa” nor did I notice the light come on indicating it had been triggered.

With Google it’s easy to go in and see all of your recordings and delete them. At least delete them from your own eyes. Who really knows if they’re deleted on Google’s end of things. I quite doubt it.
 
Comment

heov

macrumors 6502
Aug 16, 2002
266
665
I'm also skeptical of this claim from the contractor. Apple's privacy policy is pretty clear on this point, even if it doesn't mention the human oversight. I believe names and addresses might sometimes be heard if spoken aloud, but not that info is sent with contact information/addresses/location.

I think the main point is Google and Amazon seem to be unfairly criticized that humans are listening. That is their main criticism. Apple is not immune to this. Basically, what happened to Google a few weeks back can happen to Apple, too. https://www.cnbc.com/2019/07/11/google-admits-leaked-private-voice-conversations.html
 
Comment

gaximus

macrumors 65816
Oct 11, 2011
1,217
1,723
So I used to tell everyone that the reason Siri is so much worse than the others, is because they don't have real people listening in to make corrections. And that I take privacy over the better performance of other assistants. But that seems to not be the case. So what the **** Apple, I brag about Apple privacy to all my Android friends (friends with Android phones, not robot friends) and this is how you repay me. SMH
 
Comment
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.