A GoPro timelapse is also called a prolapse.
First-Person Hyper-lapse Videos
141–150 of 184 posts
Re: First-Person Hyper-lapse Videos
#142The result is quite simply breathtaking. It looks like something shot for a movie using a stabilised dollycam, the fact they were able to achieve the same thing using nothing but a GoPro, their software, and likely a week of post-processing on a high end desktop PC is simply amazing. I hope we see this technology actually become readily available. There might still be work to be done, but in general if they can repro…
The technology is already available via photosynth: http://photosynth.net/preview/view/df869f96-2765-4939-8eb3-2... It appears that what they're doing here is simply extracting keyframes from the video, using them to compose a photosynth, then converting the autoplay of the synth to a video. If you load a photosynth and press "c", you can even see a the same point clouds and scene reconstruction seen on the research…
[deleted]
Re: First-Person Hyper-lapse Videos
#143Earlier quoted context omitted.
It's striking but it's far more believable when you realize that they need to play at a much faster speed than the source, so they have tons of extra samples from which to extract information. They basically use all that data in the extra frames (that would otherwise simply get tossed away in a regular time-lapse) to construct a 3D scene. This wouldn't look nearly as good if they had to play it at normal speed.
On the flip side, it sounds like shooting at higher fps and using this to end up with a 24 or 60 fps result might end up with some cool results.
Camera movement between each frame would be minimal though so there'd be a lot of overlap between frames so minimal extra information. I'd guess the key to improving this result would be multiple cameras at different angles; I imagine it only works as well as it does because the GoPro uses a fisheye lens.
Re: First-Person Hyper-lapse Videos
#144Earlier quoted context omitted.
Ouch. I'll be going on a long bike ride in a month, and I was wondering if I could generate a hyperlapse of it... but it's going to be at least four hours, which doesn't bode well.
Back of the envelope, i get 7680 frames to process, one minute each which is just under $1300 for a medium windows azure instance. Not cheap, but probably doable. I'd bet you could spend a few hours fiddling with large memory instances versus medium, and find a sweet spot. Set aside $50-100 a month, it'll probably be a lot cheaper in a year. (assuming optimizations and cheaper cloud services)
Or you could just buy a computer and stick it in a corner running 24-7. After it has finished selecting/rendering, you have both a video and a computer you can use afterwards.
Re: First-Person Hyper-lapse Videos
#145I don't understand how computers figure out 3D from single camera video without parallax. How do they do that?
Close one eye. Move your head slightly sideways. The difference in speed of each element on the "scene" tells you how far away those objects are. Your mind makes note of all this and prepares a mental map of your surrounding area. That way you know, however roughly, where the exit door is.
This is what this system does, by using the movement of the camera to interpolate a 3D map of the area around the path taken, as well as the original images that best adjust to the part of the 3D map being seen.
Re: First-Person Hyper-lapse Videos
#146Earlier quoted context omitted.
I think what NeilSmithline is trying to say is, the microsoft technology is designed to convert regular 24fps videos to 2.4fps videos (10x time lapse). If you feed it 1 sec timelapse photos (ie, video at 1fps), the output would be 0.1fps.
I take 1 second time lapse photos and feed them at 60 frames per second for a 60x speed up. I'm not sure if you've made time lapse videos before, but it wouldn't make sense to film something at 1 fps and then play it back at 1 fps.
The frames per second I quote are all recorded frames per second (eg, for every second of real-life time that passes, how many frames in the final video were taken during that second?). Play-back rate is always 24fps (or some other fixed constant).
What we're trying to say is, if you feed your video to the program, you're going to get output that is sped-up 600x compared to real life. That's a ridiculously high speedup.
Re: First-Person Hyper-lapse Videos
#147If the MSR researchers are here -- I'm curious what does it look like when bordering hyperlapse with regular input? i.e., if there were a video consisting of input frames at the beginning and the end, with a stretch of hyperlapse in the middle, what does the transition look like? Does it need much smoothing? Also you probably saw this over the past week: http://jtsingh.com/index.php?route=information/information&i...…
Yes, I am here :-) This would be possible. Although it would require providing some UI so the user could specify which parts should be sped up. I've seen the Pjong Yang video, it is beautiful work. It requires very careful planning and shooting, and a lot of manual work to create such nice results. We're trying to make this easier for CASUAL, but it's still FAR away from the quality of professional hyperlapse.
Great, now we can ask you questions! :)
Some of the videos demonstrate unusual "popping" effects and deformations when standing still - especially notable in this video, top right, sixteen seconds in:
http://research.microsoft.com/en-us/um/redmond/projects/hype...
I understand how the extreme situation of climbing is a challenge, but what is it about standing still that causes this? Do you have any thoughts on how you might tackle this problem in future work? (although it appears you already combine an amazing breadth of techniques, so I'm not sure how many options you haven't looked at)
Re: First-Person Hyper-lapse Videos
#148If the MSR researchers are here -- I'm curious what does it look like when bordering hyperlapse with regular input? i.e., if there were a video consisting of input frames at the beginning and the end, with a stretch of hyperlapse in the middle, what does the transition look like? Does it need much smoothing? Also you probably saw this over the past week: http://jtsingh.com/index.php?route=information/information&i...…
Yes, I am here :-) This would be possible. Although it would require providing some UI so the user could specify which parts should be sped up. I've seen the Pjong Yang video, it is beautiful work. It requires very careful planning and shooting, and a lot of manual work to create such nice results. We're trying to make this easier for CASUAL, but it's still FAR away from the quality of professional hyperlapse.
[deleted]
Re: First-Person Hyper-lapse Videos
#149Earlier quoted context omitted.
>We are working hard on making our Hyperlapse algorithm available as a Windows app. Stay tuned!
Ah cool. Over the years Microsoft Research has also released demos of other cool stuff, like recreating a 3d view using multiple photos from different angles. How about those projects?
> recreating a 3d view using multiple photos from different angles
I've been waiting for that for years. Searched for it a few months ago, still nothing.
Re: First-Person Hyper-lapse Videos
#150Earlier quoted context omitted.
Ah cool. Over the years Microsoft Research has also released demos of other cool stuff, like recreating a 3d view using multiple photos from different angles. How about those projects?
> recreating a 3d view using multiple photos from different angles I've been waiting for that for years. Searched for it a few months ago, still nothing.