Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

MacRumors

macrumors bot
Original poster
Apr 12, 2001
68,713
39,655


Apple is moving forward with plans to bring a new type of image sensor with dynamic range levels approaching that of the human eye to future iPhones, according to a Weibo leaker.

iphone-16-pro-rear-cameras.jpg

Last month, Apple filed a patent titled "Image Sensor With Stacked Pixels Having High Dynamic Range And Low Noise." It described an advanced sensor architecture that combines stacked silicon, multiple levels of light capture, and on-chip noise suppression mechanisms to reach up to 20 stops of dynamic range.

For comparison, the dynamic range of the human eye is estimated to be around 20 to 30 stops, depending on how the pupil adjusts and how light is processed over time. Most smartphone cameras today capture between 10 and 13 stops. If Apple's proposed sensor reaches its potential, it would not only surpass current iPhones but also outperform many professional cinema cameras, such as the ARRI ALEXA 35.

The patent outlined a stacked sensor design made up of two layers. The top layer, called the sensor die, contains the parts that capture light. The layer underneath, the logic die, handles processing, including noise reduction and exposure control.

One of the most important parts of the sensor design is a system called a Lateral Overflow Integration Capacitor (LOFIC). This allows each pixel in the sensor to store different amounts of light depending on how bright the scene is, all in the same image. With this, the sensor can handle extremely wide lighting differences, such as a person standing in front of a bright window, without losing detail in the shadows or highlights.

Another part of the design focuses on reducing image noise and grain. Each pixel has its own built-in memory circuit that measures and cancels out heat-related electronic noise in real time. This is done on the chip itself, before the image is saved or edited by software.

According to the Weibo leaker known as "Fixed Focus Digital," the project is more than merely a patent filing at Apple. The company has reportedly already developed the sensor and could now be testing it in developmental hardware, suggesting that there are plans to bring it to a consumer device in the future.

Currently, Apple uses sensors made by Sony across the iPhone lineup. Those sensors also use a two-layer design, but Apple's proposed version includes several original features and takes up less space. Crucially, Apple transitioning to its own sensors would give it complete control over the image pipeline and follow similar moves away from using hardware from companies like Intel and Qualcomm in favor of its own custom technology.

Article Link: Apple Reportedly Developing Its Own Custom Image Sensor for iPhone
 
  • Love
Reactions: jole and SFjohn
If you (correctly) analyze that the cameras are the most important part/function for many/most users of modern smartphones, especially on the high(er) end, it makes all the sense in the world to push research and development in this area. Great to hear that this project may be much further along on the r&d timescale than previously suggested.
 
I don't care about iPhone (or any phone) cameras, really, but this is interesting. It wouldn't make me upgrade, but I'd like to see something better than what the iPhone currently has.

What I expect, however, is just bringing this in-house like the C1..aka not any better, but cheaper.
 
Hmm people be assuming it's an iPhone feature.

Seems to me the place this matters most is for the passthrough cameras in Apple Vision products.

Since it's a new technology, Apple tends to start off in smaller product markets to ramp up manufacturing and supply chains. So I could see this being a first in an Apple vision Product and then later making it to iPhone.
 
If it works out... I see this significantly boosting iPhone image quality. Both in terms of lower image noise, and greater dynamic range. The question then becomes how one can take advantage of post-processing that level of dynamic range with current displays and post-processing tools. And printing photos for hanging on the wall. No doubt Adobe is contemplating the possibilities going forward with Lightroom.

This will benefit iPhone more than AVP.
 
Camera, camera, camera. How about improving the rest of the phone? The screens haven't been significantly improved in a hot minute, the chips still run super hot, charging is still slow and battery life is just fine.

Exactly my thought.

Could we please improve some other aspects?

The camera is WAY beyond great for nearly every type of user.
The percentage of folks who are needing/wanting even more out of it are a tiny fraction.
 
If you (correctly) analyze that the cameras are the most important part/function for many/most users of modern smartphones, especially on the high(er) end, it makes all the sense in the world to push research and development in this area. Great to hear that this project may be much further along on the r&d timescale than previously suggested.
Not just this, but it could make it fairly slow for competitors to catch up creating long term diffrentiation in an area that actually matters.
 
If it works out... I see this significantly boosting iPhone image quality. Both in terms of lower image noise, and greater dynamic range. The question then becomes how one can take advantage of post-processing that level of dynamic range with current displays and post-processing tools. And printing photos for hanging on the wall. No doubt Adobe is contemplating the possibilities going forward with Lightroom.

This will benefit iPhone more than AVP.

They should diverge the lines and let the Pro phones really go wild in this direction.
 
So basically they want to cut Sony out to save money, and are making an excuse to try to justify it. Gotcha.

They should be making their own displays. You know, the part that really matters?

Nope... It's much more about giving photographers who use iPhones for making photographs significantly better image quality. Which will sell more iPhones. Since it will be Apple's image sensor, they'll also save money.

It's a very significant competitive advantage.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.