Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Interactive Dynamic Video

interactivedynamicvideo.com

Post reply on HN
Print view View original

31–40 of 59 posts

Re: Interactive Dynamic Video

#31

Post by infinite8s »

jcoffland wrote: post #25

I wonder of you could use this on car commercials and thereby deduce the actual comparative quality of construction. Assuming that better built cars would vibrate less at speed. It would be interesting to understand where the vibrations occur. A question for the authors. All the video is with vibrating but otherwise stationary objects. Must the object be stationary for these tools to work?

Not the author, but I surmise it would be much more difficult to assign vibration modes to subparts of the image in the image without being able to track them across frames.

Re: Interactive Dynamic Video

#32

Post by RivieraKid »

virgil_disgr4ce wrote: post #30
radarsat1 wrote: post #13

Dedicated host name for a single algorithm, TED talk, high-production value video with professional animations, narrator talking excitedly, more kitschy examples of applications than description of the algorithm itself. Yup, MIT.

Sarcastic whining, complaining about genuinely innovative research, missing the point, nitpicking, trying to make self seem more important by criticising everything. Yup, Hacker News Commenter. ;)

Well, it's the top comment, so it's apparently something that resonated with people. There's something quite grating about the way they try to make it... cool, I guess. Steals the focus from the content.

Re: Interactive Dynamic Video

#33

Post by RIMR »

erdevs wrote: post #22
spyder wrote: post #15

Pokemon GO and Interactive Dynamic Video: https://www.youtube.com/watch?v=9f1fCCb3hVg

Thanks for this link. Really cool use case, and maybe Niantic will check it out, if they haven't already.

Yes, my battery doesn't drain nearly fast enough when I'm playing. This would definitely fix that.

Re: Interactive Dynamic Video

#34

Post by yorwba »

jcoffland wrote: post #25

I wonder of you could use this on car commercials and thereby deduce the actual comparative quality of construction. Assuming that better built cars would vibrate less at speed. It would be interesting to understand where the vibrations occur. A question for the authors. All the video is with vibrating but otherwise stationary objects. Must the object be stationary for these tools to work?

Not one of the authors, but I had a look at their paper http://www.interactivedynamicvideo.com/ISMB_Davis_2015.pdf

They use optical flow to get displacement values for each pixel. This works well when you don't have very large movements between frames, no sudden illumination changes and no rotations.

Car commercials will probably have all of those and on top of that be highly edited (e.g. you have to deal with cuts in the video)

You could try to use some other approach for motion estimation, like identifying and tracking salient points, but that would require quite a lot of work on top of what this demo shows.

Re: Interactive Dynamic Video

#35

Post by randyrand »

erdevs wrote: post #22
spyder wrote: post #15

Pokemon GO and Interactive Dynamic Video: https://www.youtube.com/watch?v=9f1fCCb3hVg

Thanks for this link. Really cool use case, and maybe Niantic will check it out, if they haven't already.

Video analysis is usually very slow. I'm curious what their runtime is.

Re: Interactive Dynamic Video

#36

Post by spoiler »

This does look fascinating. The video is a bit showbusiness-like (for a lack of better expression).

A few questions if the author is on HN: I wonder how long it takes to analyse a 5 second video? Also, it seems the algorithm only works with static images after the initial video analysis, or am I wrong? Also, how long does it take to render the "virtual" state of the object?

Re: Interactive Dynamic Video

#38

Post by initram »

jcoffland wrote: post #25

I wonder of you could use this on car commercials and thereby deduce the actual comparative quality of construction. Assuming that better built cars would vibrate less at speed. It would be interesting to understand where the vibrations occur. A question for the authors. All the video is with vibrating but otherwise stationary objects. Must the object be stationary for these tools to work?

Probably not because in a lot of car videos there's no real car. Here's one simple example: https://www.youtube.com/watch?v=b7vTM4_rjhs

There's a company that makes a rig that's basically just an engine and 4 wheels. You film your entire commercial using it and they replace it with computer imagery of your car in post. I can't find the video at the moment, though.

Re: Interactive Dynamic Video

#39

Post by olewhalehunter »

jefe_ wrote: post #37

The consumer use cases are interesting but the propagandist use cases are terrifying. Along with this (Real-time Face Capture and Reenactment): https://www.youtube.com/watch?v=ohmajJTcpNk

Which country (or organization) do you think will be (or has already been) the first to implement a program of creating physical mimics of humans for military and intelligence purposes? With technologies like this and CRISPR, video, testimony, or genetic evidence could be thrown out the window in criminal or military cases.

Re: Interactive Dynamic Video

#40

Post by Kinnard »

RivieraKid wrote: post #32
virgil_disgr4ce wrote: post #30

Earlier quoted context omitted.

Sarcastic whining, complaining about genuinely innovative research, missing the point, nitpicking, trying to make self seem more important by criticising everything. Yup, Hacker News Commenter. ;)

Well, it's the top comment, so it's apparently something that resonated with people. There's something quite grating about the way they try to make it... cool, I guess. Steals the focus from the content.

You know, I'm somewhat skeptical of the idea that "the best" actually does always float to the top around here.
Post reply on HN