Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

First-Person Hyper-lapse Videos

research.microsoft.com

Post reply on HN
Print view View original

111–120 of 184 posts

Re: First-Person Hyper-lapse Videos

#111

Post by sitkack »

UnoriginalGuy wrote: post #7

The result is quite simply breathtaking. It looks like something shot for a movie using a stabilised dollycam, the fact they were able to achieve the same thing using nothing but a GoPro, their software, and likely a week of post-processing on a high end desktop PC is simply amazing. I hope we see this technology actually become readily available. There might still be work to be done, but in general if they can repro…

Because they drop frames, they aren't stabilizing they are throwing away frames that move too much.

This is good stuff, I like it, but it isn't as wow as the structure from motion work.

And for the folks saying just up the framerate, that won't really help because the head motion needs to back in the same position as a previous frame. It is a function of how much and at what frequency the motion you want to remove is.

This was on my todo list, item removed.

Re: First-Person Hyper-lapse Videos

#113

Post by jjcm »

UnoriginalGuy wrote: post #7

The result is quite simply breathtaking. It looks like something shot for a movie using a stabilised dollycam, the fact they were able to achieve the same thing using nothing but a GoPro, their software, and likely a week of post-processing on a high end desktop PC is simply amazing. I hope we see this technology actually become readily available. There might still be work to be done, but in general if they can repro…

The technology is already available via photosynth: http://photosynth.net/preview/view/df869f96-2765-4939-8eb3-2...

It appears that what they're doing here is simply extracting keyframes from the video, using them to compose a photosynth, then converting the autoplay of the synth to a video. If you load a photosynth and press "c", you can even see a the same point clouds and scene reconstruction seen on the research page.

Source: I worked on photosynth.

Re: First-Person Hyper-lapse Videos

#114

Post by [deleted] »

bane wrote: post #90
pron wrote: post #52

Earlier quoted context omitted.

It's striking but it's far more believable when you realize that they need to play at a much faster speed than the source, so they have tons of extra samples from which to extract information. They basically use all that data in the extra frames (that would otherwise simply get tossed away in a regular time-lapse) to construct a 3D scene. This wouldn't look nearly as good if they had to play it at normal speed.

On the flip side, it sounds like shooting at higher fps and using this to end up with a 24 or 60 fps result might end up with some cool results.

[deleted]

Re: First-Person Hyper-lapse Videos

#115

Post by steven2012 »

zodiac wrote: post #91
steven2012 wrote: post #86

Earlier quoted context omitted.

Actually, yes it's exactly what I want, I'm not sure why you would think I misunderstood what the software did. I have hundreds of gigabytes of 1 sec timelapse photos that could convert into pretty neat movies given what I saw.

I think what NeilSmithline is trying to say is, the microsoft technology is designed to convert regular 24fps videos to 2.4fps videos (10x time lapse). If you feed it 1 sec timelapse photos (ie, video at 1fps), the output would be 0.1fps.

I take 1 second time lapse photos and feed them at 60 frames per second for a 60x speed up. I'm not sure if you've made time lapse videos before, but it wouldn't make sense to film something at 1 fps and then play it back at 1 fps.

Re: First-Person Hyper-lapse Videos

#116

Post by vanderZwan »

z303 wrote: post #64
pron wrote: post #52

Earlier quoted context omitted.

It's striking but it's far more believable when you realize that they need to play at a much faster speed than the source, so they have tons of extra samples from which to extract information. They basically use all that data in the extra frames (that would otherwise simply get tossed away in a regular time-lapse) to construct a 3D scene. This wouldn't look nearly as good if they had to play it at normal speed.

Take a look at an older paper 'Content-Preserving Warps for 3D Video Stabilization'. That seems to do an ok job http://createdigitalmotion.com/2009/06/magical-3d-warping-te...

EDIT: After clicking through to their website, I found this updated technique which shares one principal author that seems to work even better: http://people.cs.nctu.edu.tw/~yushuen/VideoStabilization/

Wow. Actually, if they that add that technique to the mix it might solve the deformed "pop"-effect you see in some videos, like the deformed building you see around 16 seconds into this videos:

http://research.microsoft.com/en-us/um/redmond/projects/hype...

Re: First-Person Hyper-lapse Videos

#119

Post by ascorbic »

steven2012 wrote: post #115
zodiac wrote: post #91

Earlier quoted context omitted.

I think what NeilSmithline is trying to say is, the microsoft technology is designed to convert regular 24fps videos to 2.4fps videos (10x time lapse). If you feed it 1 sec timelapse photos (ie, video at 1fps), the output would be 0.1fps.

I take 1 second time lapse photos and feed them at 60 frames per second for a 60x speed up. I'm not sure if you've made time lapse videos before, but it wouldn't make sense to film something at 1 fps and then play it back at 1 fps.

The difference is that this requires you to record at full speed. With your timelapse you're probably taking a photo every 1 to 5 seconds or so. This system requires you to take 24fps video as your input.

Re: First-Person Hyper-lapse Videos

#120

Post by ascorbic »

Lifescape wrote: post #11

It appears as if the mountains are loading in the background (like in a video game) as you get closer to them. Awesome idea/execution!

If you watch the technical video, they say that they couldn't use the scene reconstruction for the climbing video as there were too many artefacts. This is why the rendering isn't as good as the others.
Post reply on HN