Video quality seems really good, but limitations are quite restrictive "Our model encounters challenges when processing extremely long videos (e.g. 200 frames or more)". I'd say most videos in practice are longer than 200 frames, so lot more research is still needed.
At 24fps that's not even 10 seconds. Calling it extremely long is kinda defensive.
VideoGigaGAN: Towards detail-rich video super-resolution
211–220 of 243 posts
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#212I am personally much more interested in frame rate upscalers. A proper 60Hz just looks much better then anything. Also would really, really like to see a proper 60Hz animate upscale. Anything in that space just sucks. But when in the rare cases it works it really looks next level.
Frame-rate upscaling is fine for video, but for animation it's awful. I think it's almost inherently so, because of the care that an artist takes in choosing keyframes, deforming the action, etc.
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#213Re: VideoGigaGAN: Towards detail-rich video super-resolution
#214Earlier quoted context omitted.
Easily solved, just overlap by ~40 frames and fade the upscaled last frames of chunk A into the start of chunk B before processing. Editors do tricks like this all the time.
And now you end up with 40 blurred frames for each transition.
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#215When do I have that in my Nvidia Shield? I would pay $$$ to have that in real-time ;)
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#216Is anyone else concerned at the societal effects of technology like this? In one of the examples they show a young girl. In the upscale example it's quite clearly hallucinating makeup and lipstick. I'm quite worried about tools like this perpetuating social norms even further.
No, I'm not concerned. When an AI is trained on a largely raw, uncurated set of low-quality data (eg most of the public internet), it's going to miss subtle distinctions some humans might prefer that it make. I'm confident that pretty quickly the majority of the general public using such AIs will begin to intuitively understand this. Just as they have developed a practical, working understanding of other complex tech…
GPT4 told me with no hesitation.
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#217Earlier quoted context omitted.
So sad they didn’t keep to the idea of the book. Anyone who hasn’t read this book you should, it bares no resemblance to the movie aside from the name.
I know two movies where the book is way better, Jurassic Park and Fight Club. I thought about putting spoilers in a comment to this one but i won't.
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#218Earlier quoted context omitted.
No, I'm not concerned. When an AI is trained on a largely raw, uncurated set of low-quality data (eg most of the public internet), it's going to miss subtle distinctions some humans might prefer that it make. I'm confident that pretty quickly the majority of the general public using such AIs will begin to intuitively understand this. Just as they have developed a practical, working understanding of other complex tech…
> AI lying to deny that HP Lovecraft had a childhood pet GPT4 told me with no hesitation.
I'll take that as supporting my point about the folly of wasting engineering time chasing moving goalposts. :-)
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#219[1] https://www.computer.org/csdl/proceedings-article/dcc/1992/0...
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#220Earlier quoted context omitted.
It's offtopic, but this is very good advice. As near as I can tell, there aren't any real similarities between the book and the movie; they're two separate zombie stories with the same name, and honestly I would recommend them both for wildly different reasons.
> there aren't any real similarities between the book and the movie; they're two separate zombie stories with the same name Funny - this is also a good description of I Am Legend.
https://www.cbr.com/i-robot-original-screenplay-isaac-asimov...