Apple Seemingly Restricting Generative AI Apps to 17+ or Older App Store Rating

[icanhazapple]

This is stupid. What is the difference performing a search with the Google app for X rated content, and asking an X rated question to an AI app? Absolutely nothing.

Gatekeeping by Apple - sign of weakness that they're behind with AI.

 

[icanhazapple]

Apple concerned AI-powered BlueMail might generate inappropriate content for children but Apple not concerned about advertising inappropriate games to young children

How to stop inappropriate ads - Apple Community

discussions.apple.com

How to do I stop ads like zombie apps to stop appearing in my son’s ipad? I set the Content Restrictions —> Apps to 4+ years old but it still showed inappropriate ads for games that is for older ages. I checked, State of Survival Walking Dead app is rated for 17+ years old. But it still appears in my son’s iPad.


or gambling ads

Apple removes gambling app ads placed next to kids' gaming section

According to New York Post, Apple has issued a statement saying that it has temporarily removed the gambling app suggestions.

tech.hindustantimes.com

🤣

Exactly this. Apple is like petulant child when it comes to their walled garden - rules for thee, but not for me.

 

[NMBob]

"Oh dear! This giant redwood tree has fallen across this Interstate. Let's trim off this twig. That'll take care of it." Silly humans.

Facebook has been doing "automatic" things for years. A local girl killed herself and a few weeks later "she" replied or voted on something (I forget). Her dad asked me how that could be. Then we discovered what was going on.

 

[sw1tcher]

This is stupid. What is the difference performing a search with the Google app for X rated content, and asking an X rated question to an AI app?

Google pays Apple billions a year to be default search engine, BlueMail doesn't pay Apple to be default email client??? 🤷‍♂️

😁

 

[jarman92]

I'd think younger people would be most likely to use a third party email client if it has some new or original feature like this available.

What use does a 16-year-old have for an email client at all? They don't email outside of school (if that), they communicate through Snapchat, Instagram, TikTok, iMessage/SMS, WhatsApp, etc.

 

[enterthemerdaverse]

This is stupid. What is the difference performing a search with the Google app for X rated content, and asking an X rated question to an AI app? Absolutely nothing.

Gatekeeping by Apple - sign of weakness that they're behind with AI.

Apps are prohibited from containing adult content and there is also a requirement for moderation where new content is being generated in-app.

Since that is impossible to pull off with a very flawed chat bot then age restrictions need to be applied.

 

[jarman92]

Another reason to allow other app stores on the iPhone for those who want the choice.

Yea, I'm sure all the tweens are champing at the bit to get third-party app stores so they can download email clients that don't have a meaningless "17+" label.

 

[vegetassj4]

What, did someone put up a Sultry Siri App?

 

[Yoshimura]

Yep. It's a bit silly on Apple's part but I can't imagine a 17+ rating having any effect whatsoever on usage of this app. I've never looked at an app age rating in my life, and I don't even know where to look for one.

The App Store knows where to look for age rating and can thus automatically prevent downloading.

 

[NMBob]

What use does a 16-year-old have for an email client at all? They don't email outside of school (if that), they communicate through Snapchat, Instagram, TikTok, iMessage/SMS, WhatsApp, etc.

Well, by golly, our saviors are gonna fix that evil TikTok thingamajigy with a couple of hard hitting Footloose-class laws.

 

[ajf.350d]

This is stupid. What is the difference performing a search with the Google app for X rated content, and asking an X rated question to an AI app? Absolutely nothing.

Gatekeeping by Apple - sign of weakness that they're behind with AI.

The Google App is also rated 17+ on the Apple Store, as is Bing and most browsers.

 

[icanhazapple]

Apps are prohibited from containing adult content and there is also a requirement for moderation where new content is being generated in-app.

Since that is impossible to pull off with a very flawed chat bot then age restrictions need to be applied.

You failed to answer the question how this is different than opening up the Google iOS app and performing a search and seeing prohibited content. Spare me the 'well Google isn't hosting it' nonsense.

 

[icanhazapple]

The Google App is also rated 17+ on the Apple Store, as is Bing and most browsers.

Apple doesn't require Google to verify the identity/age of the user to apply age related restrictions to search queries performed within the iOS app.

 

[VulchR]

AI is not ready for prime time with the kiddies. Already there have been examples of very disturbing interactions with some of these AI systems already. The systems do not have any knowledge of what is moral or socially appropriate. The rely on what humans have said in their training set - which, unless carefully vetted, could include all kinds of nonsense kids shouldn't be exposed to. I would imagine in a few years the need for restrictions might lessen, but for now I'd keeo any children away from AI chatbots. Indeed, we're going to have to train kids to have good BS detectors, for it will come from AI as much as twisted human extremists.

 

[3xBoom]

It is likely not about that particular mail app but any and all GPT generative apps in general, at least for the moment. Apple is protecting themselves, app devs and users here.

 

[gleepskip]

I don't understand the problem. I typed a scandalous prompt, but ChatGPT responded with:

I'm sorry, but I cannot fulfill this request as it goes against the content guidelines of this platform, which prohibits explicit or inappropriate content. Please provide a different prompt that complies with the guidelines.

ChatGPT seems to be more child-appropriate than search engines.

 

[coffeemilktea]

Normally, 17 or older age restrictions on the App Store include apps with offensive language, sexual content, or references to drugs

It does seem rather unfair to require a 17+ rating on this app, especially since I was perfectly capable of generating plenty of offensive content in emails when I was 17 and that was without any AI involved. 😤

 

[jarman92]

Apple doesn't require Google to verify the identity/age of the user to apply age related restrictions to search queries performed within the iOS app.

Apple also doesn't require age verification to download apps rated "17+", they leave it up to parents to place those limits on their kids' accounts.

 

[jarman92]

It does seem rather unfair to require a 17+ rating on this app, especially since I was perfectly capable of generating plenty of offensive content in emails when I was 17 and that was without any AI involved. 😤

I think there's a bit of a difference between a minor writing "offensive" content themselves and a minor having "offensive" content written for them by an AI, no?

 

[jarman92]

The App Store knows where to look for age rating and can thus automatically prevent downloading.

It actually can't, at least in the US. The only age "verification" that Apple does is to require a credit card for App Store purchases. Any other age restriction is imposed by parents on their kids' account.

 

[sw1tcher]

Normally, 17 or older age restrictions on the App Store include apps with offensive language, sexual content, or references to drugs

It does seem rather unfair to require a 17+ rating on this app, especially since I was perfectly capable of generating plenty of offensive content in emails when I was 17 and that was without any AI involved. 😤

Or how Snapchat, which has a age 12+ rating, is used for sexting

 

[sw1tcher]

I think there's a bit of a difference between a minor writing "offensive" content themselves and a minor having "offensive" content written for them by an AI, no?

YouTube and TikTok's AI/recommendation algorithms have been know to recommend/suggest inappropriate content to young viewers, but they both have age 12+ ratings.

YouTube's Algorithm Recommends Disturbing Videos To Kids, But Viewers Can Help Clean It Up - Tubefilter

An article about automated YouTube videos for kids has drawn attention, but parents should respond without forfeiting YouTube entirely.

www.tubefilter.com

They came to TikTok for fun. They got stuck with sexualized videos

Social media algorithms use sex and shock to hook new users. Escaping and understanding what the apps are really tracking takes time.

www.washingtonpost.com

 

[maternidad]

Microsoft's recently updated version of Bing that includes Chat GPT functionality has a 17 or older age restriction on Apple's App Store, while there is no such rating for the version of the app on Google's Play Store, suggesting it is a requirement from Apple. This indicates that Apple is already cementing strict requirements around new AI apps amid concerns about its ability to moderate generated content

All unrestricted web browsers, like the Bing app, are rated 17+ in the App Store. So we can’t draw that conclusion

 

[ThisBougieLife]

Good. AI is a cancer. I hope Apple becomes the anti-AI company.

 

[maternidad]

What use does a 16-year-old have for an email client at all? They don't email outside of school (if that), they communicate through Snapchat, Instagram, TikTok, iMessage/SMS, WhatsApp, etc.

School students may need to communicate with their teachers through email.