Live data from Hacker News

VideoGigaGAN: Towards detail-rich video super-resolution

videogigagan.github.io

31–40 of 243 posts

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#31

Earlier quoted context omitted.

I guess one can break videos into 200-frame chunks and process them independent of each other.

At 30fps, which is not high, that would mean chunks of less than 7 seconds. Doable but highly impractical to say the least.

Maybe they could do a lower framerate and then use a different AI tool to interpolate something smoother.

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#32
post #3

The first demo on the page alone shows that it is a huge failure. It clearly changes the expression of the person. Yes, it is impressive, but it's not what you want to actually "enhance" a movie.

It doesn't change the expression - the animated gifs are merely out of sync. This appears to happen because they begin animating as soon as they finish loading, which happens at different times for each side of the image.

Reloading can get them in sync. But, it seems to stop playback of the "left" one if you drag the slider completely left, which makes it easy to get desynced again.

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#35

Earlier quoted context omitted.

Or low connectivity scenarios that pushes more local processing. I think it a bit unimaginative to see no use cases for this.

There is no use case, because it is a stupid idea. Downscaling then reconstructing is a stupid idea for exactly the same reasons why downscaling for compression is a bad idea. The issue isn't NN reconstruction, but that you are reconstructing the wrong data.

if the nn is part of the codec, you can choose to only downscale the regions that get reconstructed correctly.

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#37

Video quality seems really good, but limitations are quite restrictive "Our model encounters challenges when processing extremely long videos (e.g. 200 frames or more)". I'd say most videos in practice are longer than 200 frames, so lot more research is still needed.

Still potentially useful - predict the next k frames with a sliding window throughout the video.

But idk how someone can write "extremely long videos" with a straight face when meaning seconds.

Maybe "long frame sequences"

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#38
post #23

Earlier quoted context omitted.

Why would someone ever take a 40Mbps (compressed) video and downsample it so it can be encoded at 400Kbps (compressed) but played back with nearly the same fidelity / with similar artifacts to the same process at 50x data volume? The world will never know. You're also ignoring the part where all lossy codecs throw away those same details and then fake-recreate them with enough fidelity that people are satisfied. Same…

>Why would someone ever take a 40Mbps (compressed) video and downsample it so it can be encoded at 400Kbps (compressed) but played back with nearly the same fidelity Because you can just not downscale them and compress them in the frequency domain and encode them in 200Kbps? This is pretty obvious, seriously do you not understand what JPEG does? And why it doesn't do down sampling? Do you seriously believe downscalin…

4:2:0 which is used in all common video codecs is down scaling the color data.

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#40

Video quality seems really good, but limitations are quite restrictive "Our model encounters challenges when processing extremely long videos (e.g. 200 frames or more)". I'd say most videos in practice are longer than 200 frames, so lot more research is still needed.

Fascinating how researchers put out amazing work and then claim that videos consisting of more than 200 frames are "extremely long".

Would it kill them to say that the method works best on short videos/scenes?

Post reply on HN