Video quality seems really good, but limitations are quite restrictive "Our model encounters challenges when processing extremely long videos (e.g. 200 frames or more)". I'd say most videos in practice are longer than 200 frames, so lot more research is still needed.
I guess one can break videos into 200-frame chunks and process them independent of each other.
VideoGigaGAN: Towards detail-rich video super-resolution
11–20 of 243 posts
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#12Re: VideoGigaGAN: Towards detail-rich video super-resolution
#13Earlier quoted context omitted.
Why would you ever do that? If you have the high res data you can actually compress the details which are there and then recreate them. No need to have those be recreated, when you actually have them. Downscaling the images and then upscaling them is pure insanity when the high res images are available.
So streaming services can save money on bandwidth
I think it a bit unimaginative to see no use cases for this.
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#14Earlier quoted context omitted.
Why would you ever do that? If you have the high res data you can actually compress the details which are there and then recreate them. No need to have those be recreated, when you actually have them. Downscaling the images and then upscaling them is pure insanity when the high res images are available.
So streaming services can save money on bandwidth
I think upscaling framerate would be more useful.
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#15Re: VideoGigaGAN: Towards detail-rich video super-resolution
#16Re: VideoGigaGAN: Towards detail-rich video super-resolution
#17Earlier quoted context omitted.
I guess one can break videos into 200-frame chunks and process them independent of each other.
At 30fps, which is not high, that would mean chunks of less than 7 seconds. Doable but highly impractical to say the least.
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#18Earlier quoted context omitted.
I guess one can break videos into 200-frame chunks and process them independent of each other.
At 30fps, which is not high, that would mean chunks of less than 7 seconds. Doable but highly impractical to say the least.
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#19Earlier quoted context omitted.
Why would you ever do that? If you have the high res data you can actually compress the details which are there and then recreate them. No need to have those be recreated, when you actually have them. Downscaling the images and then upscaling them is pure insanity when the high res images are available.
So streaming services can save money on bandwidth
Down sampling is a bad way to do compression. It makes no sense to do NN reconstruction on that if you could have compressed that image better and reconstructed from that data.
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#20Earlier quoted context omitted.
I agree that it's not perfect, though it does appear to be SoTA. Eventually something like this will just be part of every video codec. You stream a 480p version and let the TV create the 4K detail.
Why would you ever do that? If you have the high res data you can actually compress the details which are there and then recreate them. No need to have those be recreated, when you actually have them. Downscaling the images and then upscaling them is pure insanity when the high res images are available.