Live data from Hacker News

Scientific Breakthrough Lets SnappyCam App Take 20 Full-Res Photos Per Second

techcrunch.com

221–230 of 262 posts

Re: Scientific Breakthrough Lets SnappyCam App Take 20 Full-Res Photos Per Second

#221
post #190
post #187

It crashes for me every time I take somewhere between 60 and 75 frames with the main camera. With the front-facing camera, I can shoot forever. In the iPhone Settings (somewhere called Diagnosis & Usage), I have a bunch of LowMemory warnings. I'm using an iPhone 4S.

Thanks for reporting it in! It seems I enthusiastically chose a larger buffer size that appears to be having some issues on some devices that have a lot of memory pressure. If you reboot your phone, as awful as that sounds, it will likely fix the issue. EDIT: I've just submitted an update to Apple that uses a more conservative buffer size. This aspect is hard to get right: I once used an adaptive buffer size that hee…

Thank you, I'll try rebooting the phone.

I recently read an article here on HN that briefly touched on memory management under iOS and especially the problem of apps getting killed, maybe it is interesting for you: http://sealedabstract.com/rants/why-mobile-web-apps-are-slow... (scroll down to "How much memory is available on iOS?")

Re: Scientific Breakthrough Lets SnappyCam App Take 20 Full-Res Photos Per Second

#222

Earlier quoted context omitted.

It's just bizarre that you would be doing the complete JPEG process at the instant you get the image from the sensor. As you note, there are a plethora of steps that JPEG performs, from color space conversion, to DCT transformation (essentially a gigantic matrix multiplication), Huffman coding, quantization, arithmetic coding and encoding as JPEG bitstream. The only reason would be that you are pressed for memory or…

Why is this comment getting downvoted? I see that it adds insight to the subject and makes some good points, which OP even acknowledges. The written complaint is that revelation is not being deferential enough, which is bullshit on an in-depth technical discussion.

There's a difference between "not being deferential" (which I don't think the complaint is) and talking down to someone who's clearly built something very cool. Put another way, there's a difference between dismissing someone's approach and asking questions to try to understand it better.

Re: Scientific Breakthrough Lets SnappyCam App Take 20 Full-Res Photos Per Second

#223

WHY DONT YOU CURE CANCER INSTEAD

Actually, cancer research can benefit (admittedly by a long shot, but still) by these kind of improvements in image processing. Don't forget that medical imaging and - thereby indirectly - the recognition/detection of cancer is one of the first steps in curing said disease.

You are disrupting my narrative with facts.

Re: Scientific Breakthrough Lets SnappyCam App Take 20 Full-Res Photos Per Second

#225
post #48
post #45

That's fantastic, and a very cool demo. How does the encoder performance compare to libjpeg-turbo? That also has some SIMD work for NEON.

Yes, Nokia contributed the NEON code for the DCT in libjpeg-turbo. I haven't had a chance to do a side-by-side comparison as yet, but I suspect the SnappyCam encoder is faster for many reasons, including choice of algorithm and the way they use two multiplies (low, high) at times, and their image row-by-row nature with function call overhead in favour of code maintainability.

I was involved in some NEON work on libjpeg-turbo, and I can confirm that the image buffer management there is hell, as are some other aspects of the design. A from-scratch implementation with performance in mind should easily be quite a bit faster.

Re: Scientific Breakthrough Lets SnappyCam App Take 20 Full-Res Photos Per Second

#226
post #31

Looks like they've an instagram-type site set up too. http://snappyc.am/2LdRMF28U0 http://snappyc.am/4HHxyCad7D http://snappyc.am/3G3i6QCJUk

Impressive job! But I confirm the webapp does not work for me either, it stays blocked at 0%. I'm using FF (Nightly) 25.0 on Ubuntu 13.04 x86_64.

Re: Scientific Breakthrough Lets SnappyCam App Take 20 Full-Res Photos Per Second

#227
post #16

DCT is already lossy [1], so the statements around 8 megapixels are completely pointless, and worst of all, its 1990 lossy technology. Wavelet transformations completely destroy any DCT. That said, if their emphasis is on producing pictures with minimal time delta at highest resolution, algorithms used for still pictures are out of place. Video compression algorithms still use DCT and wavelets, but they do so only af…

You are right on the loss: it's purposefully introduced as a quantization step after performing the DCT, and before losslessly compressing the resulting coefficients with Huffman and encoding to the final JPEG bitstream. Despite all of that, JPEG has now become computationally tractable. I remember the days where it took tens of seconds to encode a JPEG on a commodity machine. Now, with the help of SIMD, we can encod…

Motion estimation/prediction is used video coding because it minimises the compressed size. However, it is incredibly expensive to perform the motion search. A typical video encoder spends well over half its CPU time in this stage. After motion estimation, the residual image is encoded in the usual way, so speed-wise the motion search is a complete loss.

Re: Scientific Breakthrough Lets SnappyCam App Take 20 Full-Res Photos Per Second

#228
post #148
post #133

Earlier quoted context omitted.

I'm Aussie, so I did my schooling in Melbourne, Australia. I don't recommend the same path for everyone, but my ugrad at RMIT University, dual bachelors of EE and CS. I then went on to do a Ph.D at the University of Melbourne in EE. My dissertation was on mathematical optimization of wireless and wireline DSL. (Prof Jamie Evans is an awesome guy if you're on the lookout for an advisor!) I've been in SFO for just over…

Congrats fellow Australian. Two of us here in an office in Adelaide just bought the app. Guy behind me said "Hey, this is pretty cool. Have you seen... oh, you're looking at it already."

I think all us Australians are coming out right now to congratulate him, haha. /Brisbane

Re: Scientific Breakthrough Lets SnappyCam App Take 20 Full-Res Photos Per Second

#229

WHY DONT YOU CURE CANCER INSTEAD

Actually, cancer research can benefit (admittedly by a long shot, but still) by these kind of improvements in image processing. Don't forget that medical imaging and - thereby indirectly - the recognition/detection of cancer is one of the first steps in curing said disease.

Very well said.

I suspect Clarity on Camera+ is some form of Contrast Limited Adaptive Histogram Equalization (CLAHE).

CLAHE came about from digital image cleanup of medical scans for human analysis.

Re: Scientific Breakthrough Lets SnappyCam App Take 20 Full-Res Photos Per Second

#230
post #64
post #63

Earlier quoted context omitted.

Wow, I'm usually pretty skeptical about these new niche social networks, but I've gotta say that is really really cool. Great work on the "living photo" idea -- that kind of adds this magical sort of feeling to it, which, I've gotta say, I felt. I hope your hard work pays off. You've built something special here :)

Thanks mate---comments like yours make my day. :-) I'm not actually planning on creating a new niche social network. I think, given the vastness of some of the ones that've emerged of late, it would be more fruitful to leverage the ones that exist today. Can't wait for you to see it!

It honestly looks like the photos from the Harry Potter movies. Love it! Great work!
Post reply on HN