Live data from Hacker News

Revolutionary "Light Field" camera tech - shoot-first, focus-later

allthingsd.com

81–90 of 97 posts

Re: Revolutionary "Light Field" camera tech - shoot-first, focus-later

#82
It's possible to buy a light field camera right now, for example from a German compamy named Raytrix (http://raytrix.de/index.php/home.181.html). I don't know whether they are the only example or whether there are other companies.

They don't name a price on their website (write them to find out) and, looking at the applications they are naming on their website (http://www.raytrix.de/index.php/applications.html), they certainly do not target consumers.

Here are their camera models if you are interested: http://www.raytrix.de/index.php/models.html

Re: Revolutionary "Light Field" camera tech - shoot-first, focus-later

#83
post #72

The downsides, which, of course, this press release doesn't mention: - Greatly, greatly reduced image resolution. Great big dedicated-camera sized lens and image sensor, cellphone-camera sized pictures. 1680×1050, at most. (1.76MP) - Color aberration. The microlenses have to be small, of course, so they're going to be made of single physical elements, rather than doublets.[1] - Various amusing aliasing problems. (not…

I realize that this type of discourse is the raison d'être of this site, but I think it's pretty funny that I came to this discussion immediately after reading today's xkcd ( http://xkcd.com/915/ )

Mouth-open really makes a statement about the quality of cheese-steak:

http://blogs.abcnews.com/.a/6a00d8341c4df253ef01347fc42e5d97...

Re: Revolutionary "Light Field" camera tech - shoot-first, focus-later

#84
post #83
post #72

Earlier quoted context omitted.

I realize that this type of discourse is the raison d'être of this site, but I think it's pretty funny that I came to this discussion immediately after reading today's xkcd ( http://xkcd.com/915/ )

Mouth-open really makes a statement about the quality of cheese-steak: http://blogs.abcnews.com/.a/6a00d8341c4df253ef01347fc42e5d97...

Truly, you are a meta-connoisseur.

Re: Revolutionary "Light Field" camera tech - shoot-first, focus-later

#86
post #58

Earlier quoted context omitted.

You cannot re-frame when shooting moving subjects - kids playing, sports, birds, cars, motorcycles, boats - there's all kinds of instances in which your subject doesn't stand still and even has unpredictable moving patterns, so keeping your subject in the center of the frame and/or re-framing is in many instances not feasible. Nikon DSLRs have this 3D tracking feature in which you select an object to keep in focus an…

> under 6MP a camera is only usable for publishing on Facebook. 2560x1600 pixels is 4.1MP. At 1:1 that will completely fill the most monstrous computer monitors one can get for under about $10k. At 300 pixels per linear inch (a very reasonable resolution for photos; about the same as the iPhone 4 "retina" display) it will give you a picture with 10" diagonal. Unless you're making posters or big prints for photographi…

Don't forget about pixel quality (it's understandable because the industry has been encouraging it for years).

A 6MP sensor would produce a fantastic 10"-diagonal print if its pixels weren't affected by noise and it was combined with a high quality lens. Unfortunately sensors of that resolution are typically small (=noisy pixels) and placed in point-and-shoot cameras (=cramped, low-quality optics).

Re: Revolutionary "Light Field" camera tech - shoot-first, focus-later

#87

The downsides, which, of course, this press release doesn't mention: - Greatly, greatly reduced image resolution. Great big dedicated-camera sized lens and image sensor, cellphone-camera sized pictures. 1680×1050, at most. (1.76MP) - Color aberration. The microlenses have to be small, of course, so they're going to be made of single physical elements, rather than doublets.[1] - Various amusing aliasing problems. (not…

"greatly reduced image resolution"

Not necessarily. If you're using a plenoptic camera purely for producing 2d images, you can reduce pixel size further than you would normally. This is because each pixel in the output image is the average of many primary pixels in the sensor. The primary pixels can be smaller and noisier while still getting a smooth output image. In rough terms the resolution loss is a cosine term over the pixel areas involved, so it's modest.

The technology also allows a tradeoff between resolution and sharpness that is novel, including the possibility of realizing resolutions beyond the diffraction limit.

The cameras used in research projects suffered reduced resolution because they were a frankenstein modification of an off the shelf DSLR. A camera designed to be plenoptic from the beginning has different constraints.

"color aberration and aliasing"

I believe these can be addressed in the processing stage. I don't see anything about either of these issues that's insurmountable.

"Low FPS. Each image requires lots of processing"

The processing can be done at any time after the fact. The primary image capture is just that, a raw image, same as any other camera.

The processing is also relatively simple convolution which can be done via FFT. Overall it's comparable to common video and image compression algorithms, not something new that requires a supercomputer in your camera.

"Proprietary toolchain"

There's no reason we can't standardize raw plenoptic images. Also, once the plenoptic raw has been processed it can be saved as any available 2d or 3d format, from png to psd to jpeg. These files will be fine in Photoshop or on the web.

"You can just produce a composite image that's sharp all over, but why not use a conventional camera with stopped-down[2] lens, then"

This allows depth of field independent of aperture size, which is a new capability. This will greatly aid low light photography, particularly dim landscapes.

But secondly, the images contain depth information, with all that implies. This is a very different tool from a stopped down lens. It's capable of realizing images that are physically imposible with a traditional lens and sensor.

"thrillingly expensive"

Citation needed. AFAIK each piece of technology involved is well understood and readily manufactured.

Re: Revolutionary "Light Field" camera tech - shoot-first, focus-later

#88
post #73

FYI Ren Ng (the founder of this company) won the 2006 ACM Doctoral Dissertation award for the research that turned into this product: http://awards.acm.org/doctoral_dissertation/

I found a couple of his publications: http://graphics.stanford.edu/papers/fourierphoto/ http://graphics.stanford.edu/papers/lfcamera/ http://graphics.stanford.edu/papers/lfmicroscope/

I read these papers in grad school in 2007. Apparently he's been working on commercializing it ever since. This guy is the real deal.

Re: Revolutionary "Light Field" camera tech - shoot-first, focus-later

#89

The downsides, which, of course, this press release doesn't mention: - Greatly, greatly reduced image resolution. Great big dedicated-camera sized lens and image sensor, cellphone-camera sized pictures. 1680×1050, at most. (1.76MP) - Color aberration. The microlenses have to be small, of course, so they're going to be made of single physical elements, rather than doublets.[1] - Various amusing aliasing problems. (not…

This is the biggest advancement in photography I've ever seen. All radical new technologies have some caveats like this initially like how LCD displays were worse than plasma for a long time. Wait a few generations for the tech to mature and I bet there will be no going back.

Re: Revolutionary "Light Field" camera tech - shoot-first, focus-later

#90

Imagine it being combined with technology that tracks your eyes motion, focusing the part of the image you're looking at automatically.

Then take it few steps further with a 360 degree fish eye lense strapped to your forehead, and some sort of VR helmet display for playback. Then take the camera while skiing, mountain climbing etc., and you would essentially have a brainscanning device like in the movies Strange Days, or Brainscan.
Post reply on HN