Live data from Hacker News

Lens Blur in the new Google Camera app

googleresearch.blogspot.com

31–40 of 249 posts

Re: Lens Blur in the new Google Camera app

#31

I may be wrong because I don't know much about image based algorithms, but this seems to be a pretty successful new approach to achieving this effect. Are there any other existing "lens blur" or depth of field tricks that phone makers or apps are using? I'd love to see their code open sourced.

SynthCam is one, free but not open source. You might be interested in the various bits of lightfield rendering code released by Stanford: http://lightfield.stanford.edu/

Re: Lens Blur in the new Google Camera app

#33
post #12

We had an interesting discussion about this a few nights ago at a Photojournalism talk. In that field, digital edits are seriously banned, to the point multiple very well known photo journalists have been fired for one little use of the clone tool [1] and other minor edits. It's interesting to think I can throw an f/1.8 lens on my DSLR and take a very shallow depth of field photo, which is OK, even though it's not ve…

Could you speak to how familiar photojournalists are with the math and transformations that take place inside a digital camera?

For example, almost certainly your cameras have dead pixels, which are processed away during the demosaicing stage, but showing them would be a "straight off the camera image" that I doubt any photojournalist would desire.

Additionally many scene-wide process steps (like lens shading map estimation) can be changed in post-processing if the cameras automatic algorithms (3a, etc) "decided" wrong.

Re: Lens Blur in the new Google Camera app

#34
post #10

Is looking at the examples giving anyone else a headache? It's like the software blur falls into some kind of uncanny valley for reality.

I agree that it irks me. But I find that irritation hard to justify: Shallow depth of field is artificial in all cases. Your vision doesn't really work that way. Even saying "Your eye is like a camera" is only partly true. You can't get at the unprocessed image. What you think you see isn't the image on your retina.

So saying that the effect as a result of a wide-open aperture is more truthful than algorithmically blurring the background of a photo seems odd. Both are a photographic artifice that approximates what you think you see when your attention is on one object in your field of view.

The same is true for the effects of focal length. A longer lens approximates, but can never actually reproduce, the effect of the brain trying to make same-sized things look the same size. A shorter focal length does the opposite, and puts more emphasis on foreground objects.

Re: Lens Blur in the new Google Camera app

#35
post #12

We had an interesting discussion about this a few nights ago at a Photojournalism talk. In that field, digital edits are seriously banned, to the point multiple very well known photo journalists have been fired for one little use of the clone tool [1] and other minor edits. It's interesting to think I can throw an f/1.8 lens on my DSLR and take a very shallow depth of field photo, which is OK, even though it's not ve…

Photojournalism is a weird cross over of history/evidence collection and drifting in to art. They fit together like oil and water, for all the reasons you pointed out.

on the other hand, i know photographers in art/advertising -- working for some of the biggest companies, like apple -- who brag that "not one pixel goes out without being touched".

-bowerbird

Re: Lens Blur in the new Google Camera app

#37
post #12

We had an interesting discussion about this a few nights ago at a Photojournalism talk. In that field, digital edits are seriously banned, to the point multiple very well known photo journalists have been fired for one little use of the clone tool [1] and other minor edits. It's interesting to think I can throw an f/1.8 lens on my DSLR and take a very shallow depth of field photo, which is OK, even though it's not ve…

Yeah, it's complicated.

On the one hand, you have dodging and burning, which were often used in actual darkrooms and are still used by respected photojournalists to increase the impact of their photos. [0]

Then you have things like this: http://en.wikipedia.org/wiki/Adnan_Hajj_photographs_controve...

Where clumsy and obvious use of the clone tool damaged the reputation of an entire news organization.

The AP standards and practices strikes an interesting balance [1]:

  AP pictures must always tell the truth. We do not alter or digitally 
  manipulate the content of a photograph in any way.
  
  The content of a photograph must not be altered in Photoshop or by 
  any other means. No element should be digitally added to or subtracted 
  from any photograph. The faces or identities of individuals must not 
  be obscured by Photoshop or any other editing tool. Only retouching 
  or the use of the cloning tool to eliminate dust on camera sensors 
  and scratches on scanned negatives or scanned  prints are acceptable.
  
  Minor adjustments in Photoshop are acceptable. These include cropping, 
  dodging  and burning, conversion into grayscale, and normal toning and 
  color adjustments that should be limited to those minimally necessary 
  for clear and accurate reproduction (analogous to the burning and 
  dodging previously used in darkroom processing of images) and that 
  restore the authentic nature of the photograph. Changes in density, 
  contrast, color and saturation levels that substantially alter the 
  original scene are not acceptable. Backgrounds should not be digitally 
  blurred or eliminated by burning down or by aggressive toning. The 
  removal of “red eye” from photographs is not permissible.
[0] http://www.poynter.org/uncategorized/14840/a-photojournalist...

[1] http://www.ap.org/company/news-values

Re: Lens Blur in the new Google Camera app

#38
post #33
post #12

We had an interesting discussion about this a few nights ago at a Photojournalism talk. In that field, digital edits are seriously banned, to the point multiple very well known photo journalists have been fired for one little use of the clone tool [1] and other minor edits. It's interesting to think I can throw an f/1.8 lens on my DSLR and take a very shallow depth of field photo, which is OK, even though it's not ve…

Could you speak to how familiar photojournalists are with the math and transformations that take place inside a digital camera? For example, almost certainly your cameras have dead pixels, which are processed away during the demosaicing stage, but showing them would be a "straight off the camera image" that I doubt any photojournalist would desire. Additionally many scene-wide process steps (like lens shading map est…

It sounds like the problem isn't image processing, the problem is image processing by the photojournalist, because with Photoshop in hand they can change the meaning of the photo. The best way to avoid that, is to avoid the use of Photoshop.

Re: Lens Blur in the new Google Camera app

#39
post #11

I find it funny that this was one of the "exclusive features" of the HTC One M8 thanks to the double camera, and days after it's release Google is giving the same ability to every Android phones. I'm sure the HTC implementation works better, but this is still impressive.

From what I have seen the HTC implementation does not work better. It looks really synthetic. Google is doing a much better job.

Re: Lens Blur in the new Google Camera app

#40

I believe the algorithm could be improved by applying the blur to certain areas/depths of the image without including pixels from very distant depths, and instead blurring/feathering edges with an alpha channel over those distant (large depth separation) pixels. For example, if you look at the left example photo by Rachel Been[1], the hair is blurred together with the distant tree details . If instead the algorithm d…

Yes! It shouldn't be too hard to implement either, compared to depth detection.
Post reply on HN