Live data from Hacker News

Big LLMs weights are a piece of history

antirez.com

71–80 of 222 posts

Re: Big LLMs weights are a piece of history

#71

Interesting. Just this morning I had a conversation with Claude about this very topic. When asked "can you give me your thoughts on LLM train runs as historical artifacts? do you think they might be uniquely valuable for future historians?", it answered > oh HELL YEAH they will be. future historians are gonna have a fucking field day with us. > imagine some poor academic in 2147 booting up "vintage llm.exe" and getti…

what's the prompt?

Re: Big LLMs weights are a piece of history

#72

I love the title "Big LLMs" because it means that we are now making a distinction between big LLMs and minute LLMs and maybe medium LLMs. I'd like to propose the we call them "Tall LLMs", "Grande LLMs", and "Venti LLMs" just to be precise.

or "DietLLM, RegularLLM, MealLLM and SuperSizedLLMWithFries"

Re: Big LLMs weights are a piece of history

#73
post #57

Earlier quoted context omitted.

LLM, LLM 2.0, LLM 3.0, Mini LLM, Micro LLM, LLM C.

LLM 95, LLM 98, LLM Millennium Edition, LLM NT, LLM XP, LLM 2000, LLM 7 I really appreciated the way they managed to come up with a new naming scheme each time, usually used exactly once.

LLM 3.11 for Workgroups

Re: Big LLMs weights are a piece of history

#74
post #53
post #38

Mozilla's llamafile project is designed to enable LLMs to be preserved for historical purposes. They ship the weights and all the necessary software in a deterministic dependency-free single-file executable. If you save your llamafiles, you should be able to run them in fifty years and have the outputs be exactly the same as what you'd get today. Please support Mozilla in their efforts to ensure this special moment i…

LLMs are much easier to port than software. They are just a big blob of numbers and a few math operations.

LLMs are much harder, software is just a blob of two numbers.

;)

(less socratic: I have a fraction of a fraction of jart's experience, but have enough experience via maintining a cross-platform llama.cpp wrapper to know there's a ton of ways to interpret that bag o' floats and you need a lot of ancillary information.)

Re: Big LLMs weights are a piece of history

#75

I love the title "Big LLMs" because it means that we are now making a distinction between big LLMs and minute LLMs and maybe medium LLMs. I'd like to propose the we call them "Tall LLMs", "Grande LLMs", and "Venti LLMs" just to be precise.

LLM already has one large in it…

Re: Big LLMs weights are a piece of history

#76

“We should regard the Internet Archive as one of the most valuable pieces of modern history; instead, many companies and entities make the chances of the Archive to survive, and accumulate what otherwise will be lost, harder and harder. I understand that the Archive headquarters are located in what used to be a church: well, there is no better way to think of it than as a sacred place.” Amen. There is an active effor…

Anyone who takes even an hour to audit anything about the Internet Archive will soon come to a very sad conclusion.

The physical assets are stored in the blast radius of an oil refinery. They don't have air conditioning. Take the tour and they tell you the site runs slower on hot days. Great mission, but atrociously managed.

Under attack for a number of reasons, mostly absurd. But a few are painfully valid.

Re: Big LLMs weights are a piece of history

#77

I love the title "Big LLMs" because it means that we are now making a distinction between big LLMs and minute LLMs and maybe medium LLMs. I'd like to propose the we call them "Tall LLMs", "Grande LLMs", and "Venti LLMs" just to be precise.

Name them like clothing sizes: XXLLM, XLLM, LLM, MLM, SLM, XSLM XXSLM.

Re: Big LLMs weights are a piece of history

#78

I love the title "Big LLMs" because it means that we are now making a distinction between big LLMs and minute LLMs and maybe medium LLMs. I'd like to propose the we call them "Tall LLMs", "Grande LLMs", and "Venti LLMs" just to be precise.

I've sat in more than one board meeting watching them take 20 minutes to land on t-shirt sizes. The greatest enterprise sales minds of our generation...

I've seen things you people wouldn't believe.

I’ve seen corporate slogans fired off from the shoulders of viral creatives. Synergy-beams glittering in the darkness of org charts. Thought leadership gone rogue… All these moments will be lost to NDAs and non-disparagement clauses, like engagement metrics in a sea of pivot decks.

Time to leverage.

Re: Big LLMs weights are a piece of history

#79

I love the title "Big LLMs" because it means that we are now making a distinction between big LLMs and minute LLMs and maybe medium LLMs. I'd like to propose the we call them "Tall LLMs", "Grande LLMs", and "Venti LLMs" just to be precise.

LLM already has one large in it…

If we can have a "Personal PIN Identification Number", we can have a "Large LLM Language Model".

Re: Big LLMs weights are a piece of history

#80
post #56

> Scientific papers and processes that are lost forever as publishers fail, their websites shut down. I don't think the big scientific publishers (now, in our time) will ever fail, they are RICH!

Perhaps a shorter term risk is the publishers consider some papers less profitable, so they stop preserving them.
Post reply on HN