Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Big LLMs weights are a piece of history

antirez.com

Post reply on HN
Print view View original

121–130 of 222 posts

Re: Big LLMs weights are a piece of history

#121

Post by thrance »

ttul wrote: post #66
dr_dshiv wrote: post #64

“We should regard the Internet Archive as one of the most valuable pieces of modern history; instead, many companies and entities make the chances of the Archive to survive, and accumulate what otherwise will be lost, harder and harder. I understand that the Archive headquarters are located in what used to be a church: well, there is no better way to think of it than as a sacred place.” Amen. There is an active effor…

Well, it did establish a new HQ in Canada… https://vancouversun.com/news/local-news/the-internet-archiv... (Edited: apparently just a new HQ and not THE HQ)

With this belligerent maniac in the White House who recently doubled-down on his wish to annex Canada [1], I wouldn't feel safe relocating there if the goal is to flee the US.

[1] https://www.nbcnews.com/politics/donald-trump/trump-quest-co...

Re: Big LLMs weights are a piece of history

#122

Post by lifthrasiir »

cowsaymoo wrote: post #113
heyjamesknight wrote: post #99

Earlier quoted context omitted.

I want to apologize for this joke in advance. It had to be done. We could take a page from Trump’s book and call them “Beautiful” LLMs. Then we’d have “Big Beautiful LLMs” or just “BBLs” for short. Surely that wouldn’t cause any confusion when Googling.

Weirdly enough, the ITU already chose the superlative for the bigliest radio frequency band to be Tremendous: - Extremely Low Frequency (ELF) - Super Low Frequency (SLF) - Ultra Low Frequency (ULF) - Very Low Frequency (VLF) - Low Frequency (LF) - Medium Frequency (MF) - High Frequency (HF) - Very High Frequency (VHF) - Ultra High Frequency (UHF) - Super High Frequency (SHF) - Extremely High Frequency (EHF) - Tremend…

AFAIK "tremendously" was chosen partly because the range includes 1 "T"Hz.

Re: Big LLMs weights are a piece of history

#124

Post by anonym29 »

ai-christianson wrote: post #89
latexr wrote: post #77

Earlier quoted context omitted.

Name them like clothing sizes: XXLLM, XLLM, LLM, MLM, SLM, XSLM XXSLM.

MLM... uh oh

I hate those ponzi schemes! Never buy a cutco knife or those crappy herbalife supplements.

Alternatively, just make sure you keep things consensual, and keep yourself safe, no judgement or labels from me :)

Re: Big LLMs weights are a piece of history

#125

Post by codr7 »

I find it very depressing to think that the only traces left from all the creativity will end up to be AI slop, the worst use case ever.

I feel like the more people use GenAI, the less intelligent they become. Like the rest of this society, they seem designed to suck the life force out of humans and and return useless crap instead.

Re: Big LLMs weights are a piece of history

#126

Post by andix »

I think it’s fine that not everything on the internet is archived forever.

It has always been like that, in the past people wrote on paper, and most of it was never archived. At some point it was just lost.

I inherited many boxes of notes, books and documents from my grandparents. Most of it was just meaningless to me. I had to throw away a lot of it and only kept a few thousand pages of various documents. The other stuff is just lost forever. And that’s probably fine.

Archives are very important, but nowadays the most difficult part is to select what to archive. There is so much content added to the internet every second, only a fraction of it can be archived.

Re: Big LLMs weights are a piece of history

#127

Post by defgeneric »

GeoAtreides wrote: post #51

Just like the map isn't the territory, so summaries are not the content nor the library fillings the actual books. If I want to read a post, a book, a forum, I want to read exactly that, not a simulacrum built by arcane mathematical algorithms.

While the post talks about big LLMs as a valuable "snapshot" of world knowledge, the same technology can be used for lossless compression: https://bellard.org/ts_zip/.

Re: Big LLMs weights are a piece of history

#128

Post by Spivak »

aziaziazi wrote: post #96
xanderlewis wrote: post #91

Earlier quoted context omitted.

And the US ‘small’ LLMs will actually be slightly larger than the ‘large’ LLMs in the UK.

I wonder how does the skinnies get dressed oversea: I wear European S which translate to XXS in the US, but there’s many people skinnier than me, still within a “normal" BMI. Do they have to find XXXS? Do they wear oversized clothes? Choosing trousers is way easier because the system of cm/inches of length+perimeter correspond to real values.

It's a crazy experience being just physically larger than most of the world. Especially when the size on the label carries some implicit shame/judgement. Like I'm skinny, I'm pretty much the lowest weight I can be and not look emaciated / worrying. But when shopping for a skirt in Asian sizes I was a 4XL, and usually an or L-2XL in European sizes. Having to shift my mental space that a US M is the "right" size for me was hard for many years. But like I guess this is how sizing was always kinda supposed to work.

Re: Big LLMs weights are a piece of history

#129

Post by andix »

visarga wrote: post #53
jart wrote: post #38

Mozilla's llamafile project is designed to enable LLMs to be preserved for historical purposes. They ship the weights and all the necessary software in a deterministic dependency-free single-file executable. If you save your llamafiles, you should be able to run them in fifty years and have the outputs be exactly the same as what you'd get today. Please support Mozilla in their efforts to ensure this special moment i…

LLMs are much easier to port than software. They are just a big blob of numbers and a few math operations.

I think software is rather easy to archive. Emulators are they key. Nearly every platform from the past can be emulated on a modern arm/x86 Linux/windows system. Arm/x86/linux/windows are ubiquitous, even if they might fade away there will be emulators around for a long time. With future compute power it should be no problem to just use nested emulation, to run old emulators on an emulated x86/linux.
Post reply on HN