Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

MacRumors

macrumors bot
Original poster
Apr 12, 2001
66,688
36,033


As outlined in a WWDC 2023 video, iOS 17 includes a new Cinematic API that enables developers to support Cinematic mode video playback and editing in third-party apps.

Cinematic-Mode-iPhone-Feature.jpg

"The Cinematic framework enables you to add professional-level editing and playback features to movies, recorded with the Camera app's Cinematic mode, to your apps," says Apple's developer documentation. "These are the same features used in applications such as Final Cut Pro, Photos, and iMovie. For example, this enables your apps to change focus distance and aperture in movies, creating a bokeh effect, even after recording."

Apple offers Cinematic mode in the Camera app on iPhone 13 models and newer. Inspired by professional Hollywood films, the feature allows users to record video with a shallow depth of field and automatic focus changes between subjects.

Cinematic mode uses a technique called "rack focus" to seamlessly shift the focus from one subject to another. It does this by locking the focus on the subject in a scene and blurring the background to achieve depth of field. If you subsequently move the camera to center on a new subject, or a new subject enters the scene, Cinematic mode automatically switches the focal point to this new subject and blurs out the background.

For more details, read How to Shoot Video in Cinematic Mode on iPhone 13 and iPhone 14.

Article Link: iOS 17 Enables Cinematic Mode Video Editing in Third-Party Apps
 
Last edited:
Seems like another API that could be used as an argument in front of the European Commission and other agencies pushing Apple to open up their systems. More public API could server as a leverage to negotiate a better deal without affecting Apple too much (like in this case).
 
Remember the big to-do they made about Cinematic Mode in the keynote when the iPhone 13 was introduced? I wonder how many people have used it.
It's a neat feature that I'm glad is available, but one I seldom use.
1) I honestly forget about it and 2) that feature doesn't work so well from the soccer pitch sidelines. 😉
But when I have used it, in more controlled settings (where subjects offer the depth of field for the feature to work properly), it's pretty sweet. Especially for a built-in feature of a camera on a phone.
 
Seems like another API that could be used as an argument in front of the European Commission and other agencies pushing Apple to open up their systems. More public API could server as a leverage to negotiate a better deal without affecting Apple too much (like in this case).
That doesn't really deal with the problem that the basic argument is "we have more APIs that can be used by developers of third-party apps that are sold exclusively through the storefront we control and for which we take 15-30% of the sale price."
 
Here's an application for a national broadcaster may find very useful for their TV/streaming field reporters.

I could imagine that would help reporters who couldn't lug their company-issued laptops; much less XDR 32" & Mac Pro Intel that have 3rd party RAM, SSD, dGPU & CPU; to the field due to danger. So long as they have a 4G/5G/WiFi connection they can do higher quality video, edit and transmit all in 1 device.

Sony did something like this with Associated Press so that workflow is from a Sony MILC camera then a Sony Xperia smartphone to be edited and uploaded via 4G/5G/WiFi.
 
I actually use cinematic mode sometimes when shooting video, but the focus switches sometimes, and adjusting the focus during editing isn’t available on iMovie. So I’m stuck either having to edit the focus on the iPhone or I’m forced to get Final Cut Pro which I wouldn’t need otherwise.

If I’m wrong and it’s doable in iMovie please correct me.
 
Focus/bokeh can be adjusted after the fact in "post", which means video recorded in Cinematic mode is in focus across the frame (to the extent possible). Selective blurring is then done computationally and reversibly.
 
Focus/bokeh can be adjusted after the fact in "post", which means video recorded in Cinematic mode is in focus across the frame (to the extent possible). Selective blurring is then done computationally and reversibly.
But it's still kind of hacky and error-prone. Unlike "low-tech" bokeh which just involves focusing the light, this requires a ton of intepretation from the device. And it can easily get it wrong with stuff like frizzy hair in the foreground. It all looks impressive on a phone screen, but if you start getting in and looking a little closer it can get messy.
 
Remember the big to-do they made about Cinematic Mode in the keynote when the iPhone 13 was introduced? I wonder how many people have used it.
I was going to ask the same question. I think I can count the number of times I've used it on one hand.
 
Here's an application for a national broadcaster may find very useful for their TV/streaming field reporters.

I could imagine that would help reporters who couldn't lug their company-issued laptops; much less XDR 32" & Mac Pro Intel that have 3rd party RAM, SSD, dGPU & CPU; to the field due to danger. So long as they have a 4G/5G/WiFi connection they can do higher quality video, edit and transmit all in 1 device.

Sony did something like this with Associated Press so that workflow is from a Sony MILC camera then a Sony Xperia smartphone to be edited and uploaded via 4G/5G/WiFi.
Yeah, no. It starts with the iphone not providing 50p (so you won't be able to deliver the standard 50i for broadcast in a lot of countries) and ends with not having control over essential features like shutter speed or audio levels in the stock app (others like filmic may do that, bit they can't shoot in cinematic mode). DoF is a "nice to have" but there are other, more important things the iPhone won't do. Besides, cinematic mode doesn't work too well, and definitely not on a level where you'd risk using it in the field.

That doesn't mean that we don't take iPhone footage for ENG - content is king. But if it's a planned shoot, there's a reason there are professional cameras with ND-filters, XLR-Audio in, manual Focus, good Lenses, a nice viewfinder, etc... you'd have to jump through hoops to use an iphone in a professional setting and even then it's a risk. Also, editing on a tiny screen with subpar software is not going to make you competitive. I have actually edited footage in the field on an ipad (but filmed on a dslr) using lumafusion and davinci resolve (have tontry final cut when I get a new iPad in a few years). But it's a slow and cumbersome process compared to proper software and takes at least twice as long as if you did it on a desktop. "Slow" is not something you'd like to be in that business.

So, as it stands now, just take a live-u unit with you and send it to the studio in realtime.
 
Last edited:
But it's still kind of hacky and error-prone. Unlike "low-tech" bokeh which just involves focusing the light, this requires a ton of intepretation from the device. And it can easily get it wrong with stuff like frizzy hair in the foreground. It all looks impressive on a phone screen, but if you start getting in and looking a little closer it can get messy.
True, but it's something that will only get better as the algorithms and networks improve, and overall it's just insanely impressive that you're even able to simulate this effect on a literal phone you carry in your pocket with a tiny little lens. The editing it in post is the cherry on top.
 
True, but it's something that will only get better as the algorithms and networks improve, and overall it's just insanely impressive that you're even able to simulate this effect on a literal phone you carry in your pocket with a tiny little lens. The editing it in post is the cherry on top.
Totally agree. It's kind of mind-blowing that it works at all!
 
  • Love
Reactions: Mr. Awesome
I actually use cinematic mode sometimes when shooting video, but the focus switches sometimes, and adjusting the focus during editing isn’t available on iMovie. So I’m stuck either having to edit the focus on the iPhone or I’m forced to get Final Cut Pro which I wouldn’t need otherwise.

If I’m wrong and it’s doable in iMovie please correct me.
You can adjust the focus points in Photos on your Mac. If you select the video and go to Edit, it'll give you that same timeline focus point interface you get in iOS.

And then from there I believe you could probably import it into iMovie? You might need to export from Photos to an MOV file or something to "freeze" the focus points? Or maybe iMovie would recognize where you set them in Photos. Worth experimenting with.
 
Howdy friends. Great discussion. I thought I'd point you to a video I just did with the top end iPhone 14. This footage was shot with the 14, transferred to my MBP with a cable- into iPhoto. Then accessed through iMovie where I could adjust focus.


If this link isn't active, you can also go to YouTube and search "Glenwood Springs, Colorado parks, and recreation". The top video is called "South Canyon".

This was puzzling to figure out for the longest time, and I finally got it down. There are some tricks. For instance, when you transfer, you have to go into settings and choose transfer original format, or it will just spit out an MOV file where depth of field cannot be adjusted.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.