Earlier quoted context omitted.
There is no consumer software that can do what the iPhone does with its sensors. iPhone HDR produces an HDR image file. Consumer HDR apps do the opposite - they take an HDR raw and tone map an sRGB JPEG out of it. The only portable format that really supports HDR images is EXR, so if you're not generating that you're not getting it. (I don't think there's anything that can do deep fusion either, though obviously you…
I don't think that's true. Capture One introduced HDR merging in one of their recent releases [0]. It does raw in "raw" out. You get a DNG out which is demosaiced. I have not yet looked to see what it's doing under the hood, and how the result compares to EXR. (But in my experience, it seems to struggle with large exposure differences, even when on a tripod). [0]: https://support.captureone.com/hc/en-us/articles/4410…
The limits of "computational photography"
191–200 of 223 posts
Re: The limits of "computational photography"
#192Earlier quoted context omitted.
I have used a program called Pixel Fixer which can learn a profile of each of your cameras and directly process out the dead pixels in the RAW files in a batch operation. It hasn't been updated in about 8 years so it doesn't necessarily support anything too recent, and is not open source, but I had some success with using it.
Does it support jpegs? Most of the cameras in question don't support RAW output but the problems are individual stuck pixels that are identical between every shot.
Re: The limits of "computational photography"
#193Earlier quoted context omitted.
Does it support jpegs? Most of the cameras in question don't support RAW output but the problems are individual stuck pixels that are identical between every shot.
Unfortunately it looks like the author only listed the possibility of future JPEG support, but it was not implemented.
Re: The limits of "computational photography"
#194Earlier quoted context omitted.
Sorry, I do not have an iPhone. How easy is the 'RAW' feature to find? I understand what you mean about most users do not need such a feature. But while supporting computers I am surprise how many features of programs users do not know exist not just because they do not use them but also how hard it is to get at some features. Personally, I seen too many programs where you need to know to turn OFF certain functions b…
To find the RAW feature you need to do two things: Go to Settings -> Camera -> toggle Apple ProRAW on Then in the Camera app there will be a "RAW" button that you can tap on to enable RAW capture Third party camera apps like Halide ( https://halide.cam ) focus on just using the RAW capabilities by default
Here’s a comparison I just made between the iPhone camera’s RAW and default modes, and Halide: https://i.ibb.co/XFMJVjz/9-DD734-F7-CA00-4-E53-85-C7-283315-...
Re: The limits of "computational photography"
#195A photon can be any color of the rainbow. The reason ink and TVs can get away with using only 3 colors is because our eyes only have 3 types of receptors (cone cells). Each receptor responds to a range of wavelengths. "In-between" wavelengths will trigger multiple receptors. For example, a TV can send a mix of red and green photons and create the same brain signals as yellow photons would. Animals with more types of receptors, such as bees or the mantis shrimp, wouldn't be fooled by a TV with only three base colors.
A camera's sensor performs the same lossy compression as our eyes. Light comes into the camera in a range of wavelengths, and triggers each type of pixel a different amount. Each type of pixel has a sensitivity curve engineered to resemble the sensitivity curve of one of the cone cells in our eyes.
Understanding that natural light isn't just red, green, and blue makes it clear why chromatic aberration can't be fixed computionally. A green pixel can't know when it's receiving green photons that are perfectly aligned, or yellow light that needs to be destorted.
P.S. There cameras that can "see" a greater range of colors. Search for "spectral cameras" and "infra-red goggles"
PPS This is also why a RGB light strip might look white, but objects illuminated by it might look odd. You might be familiar with the fact that a blue object illuminated by a red light will look black. For the same reason, it's possible for a yellow object to be eliminated by red, green, and blue light and still look black.
PPPS This is also why custom wall paints are a mixture of more than three colors. Two paints may look completely the same, but objects illuminated by the light bounced off the walls look completely different.
PPPPS This is also why high-CRI lightbulbs are a thing. If you get something hot, like the sun or a tungsten filament, it will release photons with a wide range of wavelengths. Neon tubes and LEDs emit a single wavelength, so they must be coated with phosphors that fluoresce — emit light at a different wavelength than they absorbed. Using more kinds of phosphors is more expensive, but makes it more likely that whatever object is illuminated gets all the wavelengths it is able to reflect.
Re: The limits of "computational photography"
#196Earlier quoted context omitted.
There is no reason to do this. If you want to apply the algorithms and Iphone uses, simply take a burst and post process later for HDR or whatever. I remember being in middle school and messing around with Hugin and my Minolta bridge camera… People value quick shots/edits and don’t care about quality or editing things later don’t mind an iPhone doing all this behind the scene - but it is irreversible. The sort of err…
There is no consumer software that can do what the iPhone does with its sensors. iPhone HDR produces an HDR image file. Consumer HDR apps do the opposite - they take an HDR raw and tone map an sRGB JPEG out of it. The only portable format that really supports HDR images is EXR, so if you're not generating that you're not getting it. (I don't think there's anything that can do deep fusion either, though obviously you…
Re: The limits of "computational photography"
#197Earlier quoted context omitted.
> You can’t do that easily with a dslr, certainly not like a phone is doing right now, which is integrating the last x frames and modulating the digital shutter to capture multiple exposures. Standalone cameras have been doing this for at least a decade. The same is true for nighttime exposures. That's not to say that the iPhone doesn't do it better, maybe it does, it certainly can throw more processing power at it.…
My mirror less Olympus does this as well. Set number of f stops, exposures etc all in-camera
Re: The limits of "computational photography"
#198Re: The limits of "computational photography"
#199Earlier quoted context omitted.
They already are. However, most photographers do not appreciate this type of distortion being applied to their images. At a glance, my samsung note 22 ultra takes better picture than my nikon d7500. At a glance. However, as soon as you want to actually DO anything to it, like, view it in any real detail, or on anything but a tiny screen, reality returns.. While the phone is absolutely fantastic for a quick snapshot,…
My old DSLR has a RAW+JPEG setting which will do both, I use it all the time.
Re: The limits of "computational photography"
#200Earlier quoted context omitted.
My $0.02 as some one with an expensive full-frame DSLR and and the latest iPhone Pro: There are entire categories of image quality that only Apple seems to bother even trying to improve — and then they leapt past everyone. A few years ago if you wanted to make a HDR, 4K, 60 fps Dolby Vision wide-gamut video… That would have cost you. Tens of thousands on cameras, displays, and software. It would have been a serious u…
Agreed, Apple is really pushing consumer display technology. It's tough to find FALD 1600 nit displays outside of the XDR or the MBP. Apple has also done a lot for consumer color science. However, as far as the iPhone producing HDR HEIF photos - as I recall from some brief reading, it seems like possibly an intentional choice from Apple to do this in an opaque, nonstandard way, so other image pipelines can't easily t…
This is my point. Also the HEIF files are just a still frame of a standard video format in a standard container format.
The lack of third party support is 100% laziness.