Live data from Hacker News

First-Person Hyper-lapse Videos

research.microsoft.com

41–50 of 184 posts

Re: First-Person Hyper-lapse Videos

#42
post #32
post #17

Bloody amazing! Fantastic work! Release it. Release it soon. This is something that everyone would want. I see they have listed a Windows app coming. Is that Windows desktop app?

If I were them I would offer this as a web service: upload your video and have it converted for $1.

$1 seems cheap.

Re: First-Person Hyper-lapse Videos

#43
post #40

Earlier quoted context omitted.

It's certainly way better than the source video, but it's nothing close to what would come from a steadycam or dolly. You couldn't use this finished product in any kind of real production.

I wonder if you could apply it to higher-quality (i.e. already pretty stable) input to approach a steadycam though?

I think a higher frame rate would help a lot. It's a higher sampling rate basically.

Re: First-Person Hyper-lapse Videos

#44
Nice results, but missing forest for the trees.

One of the by-products of this algorithm is fully textured 3d model representing filmed environment. Offering that as pure data dump, or even a manual process allowing user to control camera would be as valuable as fully automatic one-off timelapse no one ever watches (except maybe your granny).

What sounds better - a video tour of a house, or a 3D model of a house you can traverse however you like?

I wonder if 3 letter agencies have better structure from motion implementations a la "Enemy of the State" (Isnt it sad that this film turned out to be a documentary?). I suspect something like a 3d reconstruction of Boston Marathon (FBI did collect all video footage of the event) would be very helpful to the investigation.

Re: First-Person Hyper-lapse Videos

#45
Video stabilization + more FPS / slower rate than the "every 10 frames timelapse" + feel good inspirational music = this

I would guess that I could upload a shaky video to youtube to get it smoothed out, download it, and speed it up with similar to their rate and get similar results. The timelapse that they show that is so much worse uses way less frames of the raw footage (every 10th frame?) and goes way faster than their "hyperlapse". It isn't a fair comparison.

Re: First-Person Hyper-lapse Videos

#46

Earlier quoted context omitted.

From the paper listed on the page it looks like it takes about 305 hours to process a 10 minute video. The vast majority of that is during the "source selection" phase which takes 1 minute per frame of video.

Ouch. I'll be going on a long bike ride in a month, and I was wondering if I could generate a hyperlapse of it... but it's going to be at least four hours, which doesn't bode well.

Back of the envelope, i get 7680 frames to process, one minute each which is just under $1300 for a medium windows azure instance. Not cheap, but probably doable. I'd bet you could spend a few hours fiddling with large memory instances versus medium, and find a sweet spot.

Set aside $50-100 a month, it'll probably be a lot cheaper in a year. (assuming optimizations and cheaper cloud services)

Re: First-Person Hyper-lapse Videos

#47
post #44

Nice results, but missing forest for the trees. One of the by-products of this algorithm is fully textured 3d model representing filmed environment. Offering that as pure data dump, or even a manual process allowing user to control camera would be as valuable as fully automatic one-off timelapse no one ever watches (except maybe your granny). What sounds better - a video tour of a house, or a 3D model of a house you…

Generating a 3D model of an environment from the output of a moving camera has been done. There is obviously a lot of improvement to be done in that department, and those projects are neat, but I think it's appropriate for this project to focus on what it adds to the scene, which is camera path smoothing.

Re: First-Person Hyper-lapse Videos

#49

The server supports HTTPS, but the videos are improperly embedded resulting in mixed-content errors. This is disappointing.

Seriously, this is what you're going to talk about? Nothing about the technology? And it's "disappointing"?

Re: First-Person Hyper-lapse Videos

#50

The result is quite simply breathtaking. It looks like something shot for a movie using a stabilised dollycam, the fact they were able to achieve the same thing using nothing but a GoPro, their software, and likely a week of post-processing on a high end desktop PC is simply amazing. I hope we see this technology actually become readily available. There might still be work to be done, but in general if they can repro…

It's certainly way better than the source video, but it's nothing close to what would come from a steadycam or dolly. You couldn't use this finished product in any kind of real production.

That depends heavily on your definition of "real production," and probably quickly devolves to no true Scotsman. I absolutely think this could be used in productions I would consider real, particularly documentary/travel/reality programs and sports.
Post reply on HN