Extreme compression will be when you put in a movie and get a SORA prompt back that regenerates something close enough to the movie.
I can imagine that in under 5 years, the movie's script plus one example still photo for each scene could do the job.
Extreme video compression with prediction using pre-trainded diffusion models
11–20 of 89 posts
Re: Extreme video compression with prediction using pre-trainded diffusion models
#12It’s uncanny how much of the current stuff has been predicted by the sitcom -“Silicon Valley”
Re: Extreme video compression with prediction using pre-trainded diffusion models
#13Extreme compression will be when you put in a movie and get a SORA prompt back that regenerates something close enough to the movie.
Re: Extreme video compression with prediction using pre-trainded diffusion models
#14Extreme compression will be when you put in a movie and get a SORA prompt back that regenerates something close enough to the movie.
“Alexa show me Star Wars but with Dustin Hoffman as Luke”.
“On the other hand, I can generate endless amounts of Harlan Coben miniseries… :-P”
Re: Extreme video compression with prediction using pre-trainded diffusion models
#15> It can be observed that our model outperforms them at low bitrates It can? Maybe I'm misunderstanding the graphs but it doesn't look like it to me?
Graphs (especially PSNR) aren't a good way to judge video compression. It's better to just watch the video. Many older/commercial video codecs optimized for PSNR, which results in the output being blurry and textureless because that's the best way to minimize rate for the same PSNR.
Even with that, showing H.265 having lower PSNR than H.264 is odd --- it's the former which has often looked blurrier to me.
Re: Extreme video compression with prediction using pre-trainded diffusion models
#16From the description, it looks like it's only being tested with 128x128 frames, which implies that the speed is very low.
Re: Extreme video compression with prediction using pre-trainded diffusion models
#17> It can be observed that our model outperforms them at low bitrates It can? Maybe I'm misunderstanding the graphs but it doesn't look like it to me?
Graphs (especially PSNR) aren't a good way to judge video compression. It's better to just watch the video. Many older/commercial video codecs optimized for PSNR, which results in the output being blurry and textureless because that's the best way to minimize rate for the same PSNR.
Re: Extreme video compression with prediction using pre-trainded diffusion models
#18How fast is this and how big is the decoder/encoder? The model weights are not accessible. From the description, it looks like it's only being tested with 128x128 frames, which implies that the speed is very low.
Re: Extreme video compression with prediction using pre-trainded diffusion models
#19[1] https://en.m.wikipedia.org/wiki/Sloot_Digital_Coding_System
Re: Extreme video compression with prediction using pre-trainded diffusion models
#20Earlier quoted context omitted.
Graphs (especially PSNR) aren't a good way to judge video compression. It's better to just watch the video. Many older/commercial video codecs optimized for PSNR, which results in the output being blurry and textureless because that's the best way to minimize rate for the same PSNR.
Many older/commercial video codecs optimized for PSNR, which results in the output being blurry and textureless because that's the best way to minimize rate for the same PSNR. Even with that, showing H.265 having lower PSNR than H.264 is odd --- it's the former which has often looked blurrier to me.