Live data from Hacker News

Extreme video compression with prediction using pre-trainded diffusion models

github.com

11–20 of 89 posts

Re: Extreme video compression with prediction using pre-trainded diffusion models

#11
post #7
post #6

Extreme compression will be when you put in a movie and get a SORA prompt back that regenerates something close enough to the movie.

I can imagine that in under 5 years, the movie's script plus one example still photo for each scene could do the job.

Ah, so you have long timelines then? :P

Re: Extreme video compression with prediction using pre-trainded diffusion models

#14
post #6

Extreme compression will be when you put in a movie and get a SORA prompt back that regenerates something close enough to the movie.

“Alexa show me Star Wars but with Dustin Hoffman as Luke”.

“I’m sorry Dave. I can’t do that. As an Amazon Large Langauge model, I need you to up your subscription to Amazon Prime first.”

“On the other hand, I can generate endless amounts of Harlan Coben miniseries… :-P”

Re: Extreme video compression with prediction using pre-trainded diffusion models

#15
post #8
post #5

> It can be observed that our model outperforms them at low bitrates It can? Maybe I'm misunderstanding the graphs but it doesn't look like it to me?

Graphs (especially PSNR) aren't a good way to judge video compression. It's better to just watch the video. Many older/commercial video codecs optimized for PSNR, which results in the output being blurry and textureless because that's the best way to minimize rate for the same PSNR.

Many older/commercial video codecs optimized for PSNR, which results in the output being blurry and textureless because that's the best way to minimize rate for the same PSNR.

Even with that, showing H.265 having lower PSNR than H.264 is odd --- it's the former which has often looked blurrier to me.

Re: Extreme video compression with prediction using pre-trainded diffusion models

#17
post #8
post #5

> It can be observed that our model outperforms them at low bitrates It can? Maybe I'm misunderstanding the graphs but it doesn't look like it to me?

Graphs (especially PSNR) aren't a good way to judge video compression. It's better to just watch the video. Many older/commercial video codecs optimized for PSNR, which results in the output being blurry and textureless because that's the best way to minimize rate for the same PSNR.

Someone should train a model to evaluate video compression quality

Re: Extreme video compression with prediction using pre-trainded diffusion models

#18

How fast is this and how big is the decoder/encoder? The model weights are not accessible. From the description, it looks like it's only being tested with 128x128 frames, which implies that the speed is very low.

Why would you expect those kind of details in a paid commercial?

Re: Extreme video compression with prediction using pre-trainded diffusion models

#20
post #8

Earlier quoted context omitted.

Graphs (especially PSNR) aren't a good way to judge video compression. It's better to just watch the video. Many older/commercial video codecs optimized for PSNR, which results in the output being blurry and textureless because that's the best way to minimize rate for the same PSNR.

Many older/commercial video codecs optimized for PSNR, which results in the output being blurry and textureless because that's the best way to minimize rate for the same PSNR. Even with that, showing H.265 having lower PSNR than H.264 is odd --- it's the former which has often looked blurrier to me.

at equal bitrate?
Post reply on HN