51–60 of 89 posts
Extreme compression will be when you put in a movie and get a SORA prompt back that regenerates something close enough to the movie.
I like your sentiment, it is technically inspiring.
Extreme compression will be when you put in a movie and get a SORA prompt back that regenerates something close enough to the movie.
In what sense? How about reproducibility? Is stored memory, the connection between the prompt and the exact output, really compression or simply a retrieval of a compressed file then stored as factual knowledge ingrained in its Neural Network? I like your sentiment, it is technically inspiring.
It’s uncanny how much of the current stuff has been predicted by the sitcom -“Silicon Valley”
Extreme compression will be when you put in a movie and get a SORA prompt back that regenerates something close enough to the movie.
Where’s that quote? Something like “AI is just compression, and compression is indistinguishable from AI”
Almost. Compression and AI both revolve around information processing, but their core objectives diverge. Compression is focused on efficient representation, while AI is built for flexibility and the ability to navigate the unpredictable aspects of real-world data.
Compression learns a representation from the same data it encodes, like "testing on the training set". AI models have different training and test data. There are no surprises in compression.
Here's the research behind this: https://arxiv.org/html/2402.08934v1 As a casual non-scholar, non-AI person trying to parse this though, it's infuriatingly convoluted. I was expecting a table of "given source file X, we got file size Y with quality loss Z", but while quality (SSIM/LPIPS) is compared to standard codecs like H.264, for the life of me I can't find any measure of how efficient the compression is here. Ap…
Furthermore, it's pretty common in compression research to focus on the size/quality trade-off, and leave optimization of compute for real-world implementations.
Back in 2005 there was a collegue at my first job writing video format converters software. He was considered a genius and the stereo type of an introvert software developer. He claimed that one day an entire movie could be compressesed on a single floppydisk. Everybody laughed and thought he was weird. He might be right after all.
Extreme compression will be when you put in a movie and get a SORA prompt back that regenerates something close enough to the movie.