ChatGPT Now Interacts With Multiple Apps Inside Conversations

[MacRumors]

ChatGPT users can now interact with a handful of third-party apps directly within their conversations, OpenAI has announced.

The new Apps SDK allows developers to build tools that blend naturally into chats, and initial partners include Spotify, Canva, Zillow, Expedia, Booking.com, Coursera, and Figma.

Users can summon apps by name. For example, you can ask "Spotify, make a playlist for my party this Friday." ChatGPT can also suggest relevant apps automatically. For instance, when discussing home purchases, ChatGPT might surface Zillow to browse listings on an interactive map.

The system uses the Model Context Protocol (MCP), which gives ChatGPT access to data sources, tools, and workflows in connected apps.

The Apps SDK is now available in preview to developers. OpenAI plans to launch a full developer directory and monetization support later this year, while additional apps from DoorDash, Instacart, Uber, and AllTrails are coming soon.

The feature is available to Free, Go, Plus, and Pro users outside the EU.

Article Link: ChatGPT Now Interacts With Multiple Apps Inside Conversations

 

[KRBM]

The feature is available to Free, Go, Plus, and Pro users outside the EU.

There's your privacy warning.

 

[wanha]

just wait until companies start paying chatGPT to advertise their apps inside the chat, going to be so great

"I see you're asking about current events. Would you like to download the NYT app?"

 

[DelayedGratificationGene]

I use perplexity.

 

[jfmartin67]

Could this be a game-changer? The next "App Store", for better or for worse?

 

[Falco McGregor]

Curious to see how developers respond to ceding more control to what’s ostensibly an OS that minimizes their own brand awareness/identity.

 

[Falco McGregor]

just wait until companies start paying chatGPT to advertise their apps inside the chat, going to be so great

"I see you're asking about current events. Would you like to download the NYT app?"

Yep. All of this money and compute power is basically being used to create an all-encompassing OS in which serving you ads and stockpiling your data is the sole goal on a scale that would make Facebook or Google flinch.

 

[wonderings]

When does AI just replace many apps in general? AI becomes your assistant so watches your stocks, the weather, your calendar, your email, etc. You need something, want something your AI assistant has it covered without the need for other apps. Or maybe apps are just a back end thing to load so AI can use it and then you. never actually see it.

 

[throAU]

If you're not looking at how to use LLMs to interpret user intent and call into tools, you're sleeping on this.

I mean, we need more masterpieces like this one:

View this content on Instagram

View this content on Instagram

and this

 

[sflagel]

THIS is what that failed Humaine AI company should have done: a little box with an AI that overlaps all apps.

 

[WarmWinterHat]

Could this be a game-changer? The next "App Store", for better or for worse?

No, it's not.

If you're not looking at how to use LLMs to interpret user intent and call into tools, you're sleeping on this.

I mean, we need more masterpieces like this one:

View this content on Instagram

View this content on Instagram

and this

I don't understand why anyone one earth would want this...

Until there is a guarantee, in the TOS, that they never use my sell or sell access to my info or use it for marketing, training, or anything of the sort, then no thank you. I'm not giving my personal data, connections, calendar and associations to any AI company, not matter what the outcome or convivence is.

 

[iMac The Knife]

Now they can pull data from multiple apps for their own gain. Awesome.

 

[wanha]

When does AI just replace many apps in general? AI becomes your assistant so watches your stocks, the weather, your calendar, your email, etc. You need something, want something your AI assistant has it covered without the need for other apps. Or maybe apps are just a back end thing to load so AI can use it and then you. never actually see it.

a big concern is who do you trust enough to give their AI access to ALL of your data - your bank accounts, credit cards, calendar, contacts, communications, photos, social media accounts, etc

Also, there are many scenarios where voice operation is a terrible input mechanism (at a concert or while in bed) and you want an actual UI that you can see and touch.

And if you use AI via chat, it's that sort of like having recreated the terminal?

 

[Falco McGregor]

Any developer who complains that Apple and Google have too much control over their ecosystems and willingly signs on to this is a fool.

 

[throAU]

Until there is a guarantee, in the TOS, that they never use my sell or sell access to my info or use it for marketing, training, or anything of the sort, then no thank you. I'm not giving my personal data, connections, calendar and associations to any AI company, not matter what the outcome or convivence is.

local LLMs exist, use them.

 

[wonderings]

a big concern is who do you trust enough to give their AI access to ALL of your data - your bank accounts, credit cards, calendar, contacts, communications, photos, social media accounts, etc

Also, there are many scenarios where voice operation is a terrible input mechanism (at a concert or while in bed) and you want an actual UI that you can see and touch.

And if you use AI via chat, it's that sort of like having recreated the terminal?

Certain things I am fine with voice only. I use Alexa for weather prompts, I don't need to see it on my iPhone app. I don't disagree that there are times and places you want a UI to interact with silently though I would think that maybe in some ways that would be better to not have it. If you are at a concert maybe leave your phone in your pocket and enjoy the show. If you are in bed maybe sleep and take a break from doom scrolling or whatever else you might feel inclined to do because the idea of simply not doing anything is difficult. Not saying this is you, just people in general.

 

[throAU]

THIS is what that failed Humaine AI company should have done: a little box with an AI that overlaps all apps.

There are various pieces of software that do this today. This is what apple need to turn Siri into.

What I've wanted from Siri FOR YEARS is to help filter/screen/deal with the office overhead BS that prevents me from doing my actual job.

e.g., I had to order some network cables today. it wasted an hour of my time. Time I do not have available in my work day right now.

Hey Siri - find and order some cat6a network cables for me, X of Y m.

Siri: I found these from this vendor who has them in stock and can deliver within 24h, do you want me to raise a purchase order?

Yes! Use cost code XYZ for Project ABCDE

 

[WarmWinterHat]

local LLMs exist, use them.

I can't be bothered, nor do I want to spend the money on the hardware to do so, and I'm not using LLMs, local or otherwise, on my phone.

 

[throAU]

I can't be bothered, nor do I want to spend the money on the hardware to do so, and I'm using LLMs, local or otherwise, on my phone.

Be left behind then

 

[WarmWinterHat]

Be left behind then

I'm cool with that.

..but going back to your original post, the "masterpiece" is ridiculous, and I don't see why anyone would want such a automatic situation. If I got an automated text reply from someone saying "can't talk, grinding", I'd probably block them. It's not a masterpiece, it's over-automated slop from someone wanting clicks...no one lives like that.

When I'm busy, I just don't reply. They can wait.

 

[contacos]

When does AI just replace many apps in general? AI becomes your assistant so watches your stocks, the weather, your calendar, your email, etc. You need something, want something your AI assistant has it covered without the need for other apps. Or maybe apps are just a back end thing to load so AI can use it and then you. never actually see it.

I predict we won't even need to visit websites anymore in a few years when everything is available on demand. Imagine OpenAI really starting to monetize ChatGPT like Google did with the search. The first step is already happening with "No click" on Google Search changing the SEO game

 

[KurtWilde]

Remember folks, for any of you complaining about privacy and security and general user data issues around this, if you can’t wait for Apple solution on things like Apple Intelligence that put consumer protection forward, this is what you get.

 

[WarmWinterHat]

I predict we won't even need to visit websites anymore in a few years when everything is available on demand. Imagine OpenAI really starting to monetize ChatGPT like Google did with the search. The first step is already happening with "No click" on Google Search changing the SEO game

That's a good thing, really? You would trust openAI with your data?

I won't even use my real name with anything connected to publicly available AI.

 

[contacos]

That's a good thing, really? You would trust openAI with your data?

My intention was "neutral". Not saying it's a good or bad thing.

 

[Return Zero]

Yeah, this is 100% nope for me... One of the few things I actually agree with Elon Musk on is OpenAI's (and Sam Altman's) shadiness in transforming the company into a money machine instead of a mission-based non-profit.