Live data from Hacker News

VideoGigaGAN: Towards detail-rich video super-resolution

videogigagan.github.io

211–220 of 243 posts

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#211
post #58

Video quality seems really good, but limitations are quite restrictive "Our model encounters challenges when processing extremely long videos (e.g. 200 frames or more)". I'd say most videos in practice are longer than 200 frames, so lot more research is still needed.

At 24fps that's not even 10 seconds. Calling it extremely long is kinda defensive.

[deleted]

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#212
post #113

I am personally much more interested in frame rate upscalers. A proper 60Hz just looks much better then anything. Also would really, really like to see a proper 60Hz animate upscale. Anything in that space just sucks. But when in the rare cases it works it really looks next level.

Frame-rate upscaling is fine for video, but for animation it's awful. I think it's almost inherently so, because of the care that an artist takes in choosing keyframes, deforming the action, etc.

This just sounds like the AI is just not good enough yet. I mean it's pretty clear now that there is nothing stopping AI from producing close to or sometimes even exceeding human artists. A big problem here is good training material

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#213

Videos autoplay in full screen as I scroll in mobile. Impressive tech, but could use better mobile presentation

Yup, same here (iPhone Safari). They go fullscreen and can't dismiss them (they expand again) unless I try it very fast a few times.

Terrible viewing experience

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#214
post #193

Earlier quoted context omitted.

Easily solved, just overlap by ~40 frames and fade the upscaled last frames of chunk A into the start of chunk B before processing. Editors do tricks like this all the time.

And now you end up with 40 blurred frames for each transition.

'before processing'

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#215

When do I have that in my Nvidia Shield? I would pay $$$ to have that in real-time ;)

Are you using your Shield as an HTPC? In that case you can use the upscaler built into a TV. I prefer my LG C2 upscale (particularly the frame interpolation) compared to most Topaz AI upscales.

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#216

Is anyone else concerned at the societal effects of technology like this? In one of the examples they show a young girl. In the upscale example it's quite clearly hallucinating makeup and lipstick. I'm quite worried about tools like this perpetuating social norms even further.

No, I'm not concerned. When an AI is trained on a largely raw, uncurated set of low-quality data (eg most of the public internet), it's going to miss subtle distinctions some humans might prefer that it make. I'm confident that pretty quickly the majority of the general public using such AIs will begin to intuitively understand this. Just as they have developed a practical, working understanding of other complex tech…

> AI lying to deny that HP Lovecraft had a childhood pet

GPT4 told me with no hesitation.

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#217
post #174

Earlier quoted context omitted.

So sad they didn’t keep to the idea of the book. Anyone who hasn’t read this book you should, it bares no resemblance to the movie aside from the name.

I know two movies where the book is way better, Jurassic Park and Fight Club. I thought about putting spoilers in a comment to this one but i won't.

Disagree, Jurassic Park was an amazing movie on multiple levels, the book was just differently good, and adapting it to film in the exact format would have been less interesting (though the ending was better in the book.)

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#218

Earlier quoted context omitted.

No, I'm not concerned. When an AI is trained on a largely raw, uncurated set of low-quality data (eg most of the public internet), it's going to miss subtle distinctions some humans might prefer that it make. I'm confident that pretty quickly the majority of the general public using such AIs will begin to intuitively understand this. Just as they have developed a practical, working understanding of other complex tech…

> AI lying to deny that HP Lovecraft had a childhood pet GPT4 told me with no hesitation.

Ah, interesting. Originally, it would answer that question correctly. Then it got concern trolled in a major media outlet and some engineers were assigned to "patch it" (ie make it lie). Then that lie got highlighted some places (including here on HN), so I assume since then some more engineers got assigned to unpatch the patch.

I'll take that as supporting my point about the folly of wasting engineering time chasing moving goalposts. :-)

Re: VideoGigaGAN: Towards detail-rich video super-resolution

#220

Earlier quoted context omitted.

It's offtopic, but this is very good advice. As near as I can tell, there aren't any real similarities between the book and the movie; they're two separate zombie stories with the same name, and honestly I would recommend them both for wildly different reasons.

> there aren't any real similarities between the book and the movie; they're two separate zombie stories with the same name Funny - this is also a good description of I Am Legend.

And similarly, I, Robot, which is much more enjoyable when you realize it started as an independent murder-mystery screenplay that had Asimov’s works shoehorned in when both rights were bought in quick succession. I love both the movie and the collection of short stories, for vastly different reasons.

https://www.cbr.com/i-robot-original-screenplay-isaac-asimov...

Post reply on HN