This is great for entertainment (and hopefully the main application), but we need clear marking of such type of videos before hallucinated details are used as "proofs" of any kind by people not knowing how this works. Software video/photography on smartphones is already using proprietary algorithms that "infer" non-existent or fake details, and this would be at an even bigger scale.
VideoGigaGAN: Towards detail-rich video super-resolution
81–90 of 243 posts
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#82Another boon for the porn industry
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#83Re: VideoGigaGAN: Towards detail-rich video super-resolution
#84This is amazing and all but at what point do we reach the point of there is no more “real” data to infer from low resolution? In other words there are all sorts of information theory research on the amount of unique entropy on a given medium and even with compression there is a limit. How does that limit relate to work like this? Is there a point at which it can say we know it’s inventing things beyond x scaling cons…
The start point. Upscaling is by definition creating information where there wasn't any to begin with.
Nearest neighbor filtering is technically inventing information, it's just the dumbest possible approach. Bilinear filtering is slightly smarter. This approach tries to be smarter still by applying generative AI.
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#85Re: VideoGigaGAN: Towards detail-rich video super-resolution
#86This is great for entertainment (and hopefully the main application), but we need clear marking of such type of videos before hallucinated details are used as "proofs" of any kind by people not knowing how this works. Software video/photography on smartphones is already using proprietary algorithms that "infer" non-existent or fake details, and this would be at an even bigger scale.
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#87Video quality seems really good, but limitations are quite restrictive "Our model encounters challenges when processing extremely long videos (e.g. 200 frames or more)". I'd say most videos in practice are longer than 200 frames, so lot more research is still needed.
At 24fps that's not even 10 seconds. Calling it extremely long is kinda defensive.
For animations it's around 15 seconds.
Re: VideoGigaGAN: Towards detail-rich video super-resolution
#88This is great. I look forward to when cell phones run this at 60fps. It will hallucinate wrong, but pixel perfect moons and license plate numbers.
Just get a plate with 'AAAAA4' and blame everything on 'AAAAAA'