Apple to Add AI Video Descriptions and Smarter Notifications to Home App

[MacRumors]

Apple today announced new Apple Intelligence features for the Home app, including AI-generated descriptions of HomeKit Secure Video camera clips and smarter grouping of accessory notifications.

The Home app will use Apple Intelligence to analyze recorded clips from compatible cameras and generate text descriptions summarizing what happened in them. Users can search through footage to find specific events, such as a package delivery, without needing to watch each clip individually.

The app will also surface noteworthy clips at the top of the Search page, so users can quickly identify important moments. When playing a clip, the Home app can pull together footage from multiple cameras to provide a more complete picture of an event.

Apple Intelligence will also make accessory notifications smarter. Rather than receiving a separate alert for every triggered accessory, the Home app will understand related notifications as a single ongoing activity and deliver one notification that continues to update as the activity unfolds.

Article Link: Apple to Add AI Video Descriptions and Smarter Notifications to Home App

 

[McKodiak]

Did I also hear during the keynote that HomeKit Secure Video will record 4k?

 

[Sir Ruben]

Your husband arrived home with a blonde woman on his arm.

A blonde woman left the house an hour later.

 

[BeatCrazy]

Long overdue!

I feed my HomeKit camera feeds via RSTP to a Blue Iris server, and I was about to upgrade it with a dedicated GPU to use some open-source models for AI detection.

I am hoping a native Apple application will be much more stable and easier to use.

Regarding 4K... I wonder what the threshold for compatible cameras is? Some are more like 3K sensors, which would be nice if we could get feeds greater than 1080p, if not quite 4K.

 

[MysteriousStain]

That’s the end of my double life of leaving fruit bowls in people’s homes

 

[I am Sampson]

I wonder if this will support feeds from Frigate and/or HAOS. That could be useful.

 

[TheDailyApple]

A package was delivered.
...
A package was picked up.

 

[noah82]

I wonder if this will support feeds from Frigate and/or HAOS. That could be useful.

I have all of my Unifi Protect cameras fed into Homekit using Scrypted. Looks like the activities are showing up on the common feed now, but AI notifications don't look to be live yet.

 

[I am Sampson]

Yes. Only just reading about scrypted now. Will have to see if my NAS can handle that on top of its current frigate / HAOS and other duties.

 

[tliede20]

My Aqara Doorbell doesn't seem to be feeding into the Home App anymore... I'm sure this will correct with time, but unfortunate for the time being.

 

[ipedro]

My Aqara Doorbell doesn't seem to be feeding into the Home App anymore... I'm sure this will correct with time, but unfortunate for the time being.

Depends on how you set it up. I set up mine through HomeKit in the Apple Home app exclusively, don't even have the Aqara app installed.

 

[svish]

Very useful change. Apple's focus on home devices is increasing and also waiting to see the rumored security camera from Apple.

 

[Itinj24]

Home got some good camera updates. Was hoping we’d get a mention of Matter 1.5 though (camera support). Guess they can add that at any time during the cycle but always lagging and limited on Matter updates.

 

[insomniac86]

Cool but they have really messed up.
You can no longer browse by date and time!!! Like that’s the first thing you see asked If you need to provide footage. Instead you need to manually scroll through each clip checking its time stamp. WTF Apple!?

 

[jtfolden]

Mine doesn't seem to be naming recognized faces in video clip the description? It will just say "Someone was detected" but yet the actual notification has the name of the person that arrived...

 

[Itinj24]

Mine doesn't seem to be naming recognized faces in video clip the description? It will just say "Someone was detected" but yet the actual notification has the name of the person that arrived...

Cool but they have really messed up.
You can no longer browse by date and time!!! Like that’s the first thing you see asked If you need to provide footage. Instead you need to manually scroll through each clip checking its time stamp. WTF Apple!?

We’re still months away from a public release. This is developer beta 1. Just came out yesterday. Please provide feedback and report any and all bugs to Apple. That’s the point of a beta cycle. Not just to try out the new stuff early.

As for the browsing by date and time, does it work if you search by date and time in the search function?

 

[jtfolden]

We’re still months away from a public release. This is developer beta 1. Just came out yesterday. Please provide feedback and report any and all bugs to Apple. That’s the point of a beta cycle. Not just to try out the new stuff early.

Why would you assume I have not already provided feedback? Just because I'm also posting here? This is a discussion forum after all.

 

[Itinj24]

Why would you assume I have not already provided feedback? Just because I'm also posting here? This is a discussion forum after all.

But I said please.

 

[tliede20]

Depends on how you set it up. I set up mine through HomeKit in the Apple Home app exclusively, don't even have the Aqara app installed.

It was working fine before iOS 27, technically it still works, but the display in the Home app shows an error, but you can see the preview behind the error, it's a strange bug.