Live data from Hacker News

First-Person Hyper-lapse Videos

research.microsoft.com

21–30 of 184 posts

Re: First-Person Hyper-lapse Videos

#22

Great results but looks expensive. I wonder how many minutes of processing per minute of video.

From the paper listed on the page it looks like it takes about 305 hours to process a 10 minute video. The vast majority of that is during the "source selection" phase which takes 1 minute per frame of video.

Sounds like something that would be good for a cloud service to provide. Upload your video and let their farm of tuned servers churn on it for a while.

Re: First-Person Hyper-lapse Videos

#23

Great results but looks expensive. I wonder how many minutes of processing per minute of video.

From the paper listed on the page it looks like it takes about 305 hours to process a 10 minute video. The vast majority of that is during the "source selection" phase which takes 1 minute per frame of video.

Ouch. I'll be going on a long bike ride in a month, and I was wondering if I could generate a hyperlapse of it... but it's going to be at least four hours, which doesn't bode well.

Re: First-Person Hyper-lapse Videos

#24

The result is quite simply breathtaking. It looks like something shot for a movie using a stabilised dollycam, the fact they were able to achieve the same thing using nothing but a GoPro, their software, and likely a week of post-processing on a high end desktop PC is simply amazing. I hope we see this technology actually become readily available. There might still be work to be done, but in general if they can repro…

You think a week of post end processing? I didn't read the paper or anything so I could be way off base, but I would assume the algo simply has to choose which frames to keep and which to toss. I doubt this would take an enormous amount of time even with HD videos. The algo is most likely just really clever in how it chooses a good frame vs a bad one.

On the other hand, if it is actually generating a lot of "best guess" images to put between gaps that are too large to bridge (too many bad frames in a row) with the current frames I could see that taking a bit longer, but not a week.

Re: First-Person Hyper-lapse Videos

#25
post #24

The result is quite simply breathtaking. It looks like something shot for a movie using a stabilised dollycam, the fact they were able to achieve the same thing using nothing but a GoPro, their software, and likely a week of post-processing on a high end desktop PC is simply amazing. I hope we see this technology actually become readily available. There might still be work to be done, but in general if they can repro…

You think a week of post end processing? I didn't read the paper or anything so I could be way off base, but I would assume the algo simply has to choose which frames to keep and which to toss. I doubt this would take an enormous amount of time even with HD videos. The algo is most likely just really clever in how it chooses a good frame vs a bad one. On the other hand, if it is actually generating a lot of "best gue…

It does 3D scene and camera path reconstructions then re-renders the scene from different perspectives. It's not just "picking the best frames". The technical explanation video goes into the details: https://www.youtube.com/watch?v=sA4Za3Hv6ng

Re: First-Person Hyper-lapse Videos

#26

Earlier quoted context omitted.

From the paper listed on the page it looks like it takes about 305 hours to process a 10 minute video. The vast majority of that is during the "source selection" phase which takes 1 minute per frame of video.

Sounds like something that would be good for a cloud service to provide. Upload your video and let their farm of tuned servers churn on it for a while.

With an option to host it too, considering they can provide higher bitrates:- https://news.ycombinator.com/item?id=8160890

Upload video, generate hyperlapse, generate a URL and view the higher bitrate video on iPhone, Android or Windows. Considering GoPro/Drone videos generate lots of interest, this will be a very highly useful service.

Re: First-Person Hyper-lapse Videos

#27

Great results but looks expensive. I wonder how many minutes of processing per minute of video.

From the paper listed on the page it looks like it takes about 305 hours to process a 10 minute video. The vast majority of that is during the "source selection" phase which takes 1 minute per frame of video.

Prediction: When Microsoft releases this as an app it will be heavily leveraged with Azure to create fast results. Especially if the bulk of the work is in the source selection which, I believe, can be easily done in parallel.

Re: First-Person Hyper-lapse Videos

#28
post #15

It appears as if the mountains are loading in the background (like in a video game) as you get closer to them. Awesome idea/execution!

Haha, I was just going to post that. It really gives off a mipmapping&LoD game/progressive-loading effect. So weird.

And the running speed of the original Doom / Doom 2 games.

Re: First-Person Hyper-lapse Videos

#29

The result is quite simply breathtaking. It looks like something shot for a movie using a stabilised dollycam, the fact they were able to achieve the same thing using nothing but a GoPro, their software, and likely a week of post-processing on a high end desktop PC is simply amazing. I hope we see this technology actually become readily available. There might still be work to be done, but in general if they can repro…

It's certainly way better than the source video, but it's nothing close to what would come from a steadycam or dolly. You couldn't use this finished product in any kind of real production.

Re: First-Person Hyper-lapse Videos

#30
post #24

The result is quite simply breathtaking. It looks like something shot for a movie using a stabilised dollycam, the fact they were able to achieve the same thing using nothing but a GoPro, their software, and likely a week of post-processing on a high end desktop PC is simply amazing. I hope we see this technology actually become readily available. There might still be work to be done, but in general if they can repro…

You think a week of post end processing? I didn't read the paper or anything so I could be way off base, but I would assume the algo simply has to choose which frames to keep and which to toss. I doubt this would take an enormous amount of time even with HD videos. The algo is most likely just really clever in how it chooses a good frame vs a bad one. On the other hand, if it is actually generating a lot of "best gue…

Maybe you should watch the technical video or read the paper before commenting.
Post reply on HN