What's in a GGUF, besides the weights – and what's still missing? • Hacker News Board

Re: What's in a GGUF, besides the weights – and what's still missing?

#61

Post by woctordho » Sun, May 17, 2026, 1:24 AM UTC

aktuel wrote: post #20

amelius wrote: post #17

> user Hi there! model Hi there, how can I help you today Good lord, they managed to invent a format that is even less readable than XML.

It is not supposed to be readable by humans. You rarely have to look at it. It is designed to not get confused with the actual content, where the content can be any random text from the internet. For that, you have to use a format that is not used anywhere else.

Sadly, they need to be writable by humans. That's why we see the Unsloth guys fix bugs in chat templates again and again.

Re: What's in a GGUF, besides the weights – and what's still missing?

#62

Post by halyconWays » Sun, May 17, 2026, 1:50 AM UTC

jart wrote: post #59

halyconWays wrote: post #42

Fun lore, GGUFs were once called GGJTs until I caught the "JT" (Justine Tunney) stealing the memory map code from a user who did 99% of the work in a draft PR (slaren) and lying about it, and misrepresenting or not understanding how memory map worked. She wanted her initials in the file format for bragging rights because it was claimed that it caused 90% memory reduction (actually it was just lazy loading into memory…

Have you ever read my side of the story? https://justine.lol/dox/4chan.txt

I recall reading it and you mischaracterize and conflate the core issues with accusations of hate and mean words, which is an inappropriate deflection and an attempt to control the narrative. The core issues were always plagiarism, misrepresentation of another user's work, refusal to give proper credit to the real author, and you bragging about it when you thought you could get away with it with quotes like "great artists steal." You never took accountability nor grasped the seriousness of what you attempted to do. You don't seem to understand WHY you faced blowback. You never expressed regret that the person you were victimizing was deeply depressed and pushed moreso by your betrayal. It's always "me, me, me." Your behavior and response is toxic.

Re: What's in a GGUF, besides the weights – and what's still missing?

#63

Post by jart » Mon, May 18, 2026, 4:01 AM UTC

halyconWays wrote: post #62

jart wrote: post #59

Earlier quoted context omitted.

Have you ever read my side of the story? https://justine.lol/dox/4chan.txt

I recall reading it and you mischaracterize and conflate the core issues with accusations of hate and mean words, which is an inappropriate deflection and an attempt to control the narrative. The core issues were always plagiarism, misrepresentation of another user's work, refusal to give proper credit to the real author, and you bragging about it when you thought you could get away with it with quotes like "great ar…

I only wrote that text file a few weeks ago. Also isn't stealing code what open source is all about?

If only you could see how much code I've stolen from Rich Felker, David Gay, Sun Microsystems, etc.

Re: What's in a GGUF, besides the weights – and what's still missing?

#64

Post by halyconWays » Mon, May 18, 2026, 10:42 PM UTC

jart wrote: post #63

halyconWays wrote: post #62

Earlier quoted context omitted.

I recall reading it and you mischaracterize and conflate the core issues with accusations of hate and mean words, which is an inappropriate deflection and an attempt to control the narrative. The core issues were always plagiarism, misrepresentation of another user's work, refusal to give proper credit to the real author, and you bragging about it when you thought you could get away with it with quotes like "great ar…

I only wrote that text file a few weeks ago. Also isn't stealing code what open source is all about? If only you could see how much code I've stolen from Rich Felker, David Gay, Sun Microsystems, etc.

Stealing code and credit (and being unrepentant) is actually what gets you into situations like that one. I read your document and you still seem to think you're a victim.

Also I must've been mistaken about you having been unbanned from llama.cpp, as I'm sure you're aware that being so brazen and unrepentant about your plagiarism and victimization of another developer would have risked your access once again. It's a shame you've not grown as an open source contributor

Re: What's in a GGUF, besides the weights – and what's still missing?

#65

Post by xoxos » Wed, May 20, 2026, 9:17 AM UTC

Philpax wrote: post #26

I regret that the projection models ended up separate, and I too would have preferred for them to be in a single file. I'm not entirely sure why that ended up happening, but it very much runs counter to the single-file ethos I had in mind when I designed GGUF. Hoping that someone will shepherd the cause of merging the two; I think I'm too out of the loop to do it this time around :-)

hi, first post. 56 year old world's foremost procedural audio programmer xoxos vst, wrote the world's first procedural lyrical engine in 1994.

just about every field has documented cancellation of my egalitarian work for the apron brethren. it would be nice if this species could explain how to use a text to image without leaving which mess of 30g worth of downloads to try.

please, just someone SAY what things i need just once simply without going "you need 5G 5G 5G 5G 5G 5G"

your species doesn't work since the Emm Kay heterodyning from orbit. since rely, natural kinda ears to west papua FOR A REASON