Live data from Hacker News

First-Person Hyper-lapse Videos

research.microsoft.com

151–160 of 184 posts

Re: First-Person Hyper-lapse Videos

#151
Very nice! Is there software available I can use, or do I have to implement the algorithms from the paper myself?

I make a lot of 4K hyperlapse movies, it is tedious as AfterEffect's warp stabilizer is useful only in a small fraction of cases, Deshaker is more consistent but also not perfect, and the only option in the end is multi-pass manual tracking and stabilizing which is very time consuming and tricky for long panning shots.

Re: First-Person Hyper-lapse Videos

#153
post #151

Very nice! Is there software available I can use, or do I have to implement the algorithms from the paper myself? I make a lot of 4K hyperlapse movies, it is tedious as AfterEffect's warp stabilizer is useful only in a small fraction of cases, Deshaker is more consistent but also not perfect, and the only option in the end is multi-pass manual tracking and stabilizing which is very time consuming and tricky for long…

according to the website: "We are working hard on making our Hyperlapse algorithm available as a Windows app. Stay tuned!"

Re: First-Person Hyper-lapse Videos

#155
post #135
post #32

Earlier quoted context omitted.

If I were them I would offer this as a web service: upload your video and have it converted for $1.

Someone above mentioned the processing took weeks. So.. I'm not sure that would work.

Well, the first version took weeks. I'm sure it will only get faster.

Re: First-Person Hyper-lapse Videos

#156
post #150
post #149

Earlier quoted context omitted.

> recreating a 3d view using multiple photos from different angles I've been waiting for that for years. Searched for it a few months ago, still nothing.

Er, http://photosynth.net/

That's it! Why doesn't Microsoft add this to their store or, better yet, bundle it with Windows 8 and Windows phone ??

They may not be killer apps but it is one way for Microsoft to distinguish itself from Apple and Google.

Re: First-Person Hyper-lapse Videos

#157
post #46

Earlier quoted context omitted.

Back of the envelope, i get 7680 frames to process, one minute each which is just under $1300 for a medium windows azure instance. Not cheap, but probably doable. I'd bet you could spend a few hours fiddling with large memory instances versus medium, and find a sweet spot. Set aside $50-100 a month, it'll probably be a lot cheaper in a year. (assuming optimizations and cheaper cloud services)

Or you could just buy a computer and stick it in a corner running 24-7. After it has finished selecting/rendering, you have both a video and a computer you can use afterwards.

Yeah, I'm more likely to go with this option, rather than spend over a grand on a video that may end up looking like crap anyway.

Re: First-Person Hyper-lapse Videos

#158

As others have commented, the videos look great, and much closer to how people remember journeys. However, there appear to be some image persistence problems (many street poles simply dissolve as they get closer to the camera). I'm curious to see what happens if they insert more action-packed footage. An MTB course with trees, switchbacks, and jumps would be an interesting stress test of this technique.

They do frame selection first, then create a 3D scene from the fewer frames. So that light pole might not have been in enough of the chosen frames to get a good 3D model of it. And the first stage has a pretty low-res 3D model because the number of points just gets crazy, so the light pole probably wouldn't have been modeled anyway.

Re: First-Person Hyper-lapse Videos

#159
post #24

Earlier quoted context omitted.

You think a week of post end processing? I didn't read the paper or anything so I could be way off base, but I would assume the algo simply has to choose which frames to keep and which to toss. I doubt this would take an enormous amount of time even with HD videos. The algo is most likely just really clever in how it chooses a good frame vs a bad one. On the other hand, if it is actually generating a lot of "best gue…

The paper says it took 23,700 minutes to do just the frame selection for the 13 minute bike input video. That's over two weeks.

Actually it says that it took 13 minutes to process 23,700 frames! :)

Re: First-Person Hyper-lapse Videos

#160
post #24

Earlier quoted context omitted.

You think a week of post end processing? I didn't read the paper or anything so I could be way off base, but I would assume the algo simply has to choose which frames to keep and which to toss. I doubt this would take an enormous amount of time even with HD videos. The algo is most likely just really clever in how it chooses a good frame vs a bad one. On the other hand, if it is actually generating a lot of "best gue…

The paper says it took 23,700 minutes to do just the frame selection for the 13 minute bike input video. That's over two weeks.

[deleted]
Post reply on HN