Viewing profile — spidy__

yep!!

Ummm I don't have a lot of idea about crypto but in compression the idea was that you just share the model along with the metadata file to the other user and they de compress it, n…

If I were only using a transformer that would have been true, but we use arithmetic coding alongside our transformer to fix those mistakes (layman terms). You can read about arithm…

Ohh that "what I tried that didn't work" was a section that I specifically wrote myself (and then polished with AI) because I wanted to document what are the different approaches I…

I mean neural compressors provide great compression, BUTT the issue is they are really slow like in my project it takes around 45 minutes for de compression of 100 mb so I doubt if…

I tried with zstd 19

Ofcourse, am doing this just because I enjoy it. While we are on the discussion I have mentioned a question at the end of the discussion around an assumption am trying, can you ple…

[dead]

Ohh yeah , I took it from Project Nayuki as mentioned in the file as well, i tried to pip install it but there were some issues so just took the file and kept the copy right as it …

Oh, sounds interesting. I hadn't considered using a diffusion model for this. My current approach generates the document byte by byte with an autoregressive transformer, so I'm cur…

1. I wrote the content as what i want to mention in the documentation and just used AI to polish it so that its easy to understand, is it hard to understand the documentation right…

I might be confused by the question, but I overfit the model on a single file and then transport the model along with the arithmetic coding file. There have been ideas where you ge…

Yeah yeah, I just found the idea kinda interesting so wanted to implement it

Sounds interesting man, soo am a bit confused maybe but can you run this on enwik9?

For the model overhead to become significant enough to eat into the gains, the file size would need to be fairly small, right? I assumed nobody would use this for compressing anyth…

Reallly?? So have you published something so far? Can i read something? Sounds like you got some interesting ideas.

I tried it on a enwik9 100 mb slice and was able to compress it to 20 mb + 900kb transformer so 21mb. I know the top submission was able to get it to 13 mb. Still trying some ideas…

I built an experiment that uses an overfitted transformer and arithmetic coding to compress individual files. Instead of training the model to generalize, I train a 900KB transform…