Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Big LLMs weights are a piece of history

antirez.com

Post reply on HN
Print view View original

191–200 of 222 posts

Re: Big LLMs weights are a piece of history

#191

Post by jart »

xpe wrote: post #174
jart wrote: post #165

Earlier quoted context omitted.

I just wanted to share an essay I liked. I didn't think you'd pay it much mind. But I can see now that you are a person devoted to science. If you want to know what I believe, I think computers in the 50's were intelligent. I think gpt2 probably qualified as agi if you take the meaning of the acronym literally. At this point we've blown so far past all expectations in terms of intelligence that I've come to agree wit…

To continue my earlier comment... I prefer not to call an LLM "intelligent" much less "outrageously intelligent". Why? The main reason is communication clarity -- and by communication I mean the notion of a sender communicating a meaning to a receiver. Not just symbolic information (a la Shannon), but a faithful representation in the recipient. The phrase "outrageously intelligent" can have many conflicting interpret…

Intelligence is closely related to the concept of attractiveness and gravitas. You say it depends on the agent. I say it's in the eye of the beholder. People aren't very good at explaining what attracts them either.

The closest thing we have to a definition for intelligence is probably the LLMs themselves. They're very good at predicting words that attract people. So clearly we've figured it out. It's just such a shame that this definition for intelligence is a bunch of opaque tensors that we can't fully explain.

LLMs don't just defy human reasoning and understanding. They also challenge the purpose of intelligence itself. Why study and devise systems, when gradient descent can figure it out for you? Why be cleverer when you can just buy more compute?

I don't know what's going to make the magical black pill of machine learning more closely align with our values. But I'm glad we have them. For example, I think it's good that people still hold objectivity as a virtue and try to create well-defined benchmarks that let us rank the merits of LLMs using numbers. I'm just skeptical about how well our efforts to date have predicted the organic processes that ultimately decide these things.

Re: Big LLMs weights are a piece of history

#192

Post by krageon »

Spivak wrote: post #128
aziaziazi wrote: post #96

Earlier quoted context omitted.

I wonder how does the skinnies get dressed oversea: I wear European S which translate to XXS in the US, but there’s many people skinnier than me, still within a “normal" BMI. Do they have to find XXXS? Do they wear oversized clothes? Choosing trousers is way easier because the system of cm/inches of length+perimeter correspond to real values.

It's a crazy experience being just physically larger than most of the world. Especially when the size on the label carries some implicit shame/judgement. Like I'm skinny, I'm pretty much the lowest weight I can be and not look emaciated / worrying. But when shopping for a skirt in Asian sizes I was a 4XL, and usually an or L-2XL in European sizes. Having to shift my mental space that a US M is the "right" size for me…

The shame you feel is yours, it's not inherent to the sizing.

Re: Big LLMs weights are a piece of history

#193

Post by vintermann »

aziaziazi wrote: post #96
xanderlewis wrote: post #91

Earlier quoted context omitted.

And the US ‘small’ LLMs will actually be slightly larger than the ‘large’ LLMs in the UK.

I wonder how does the skinnies get dressed oversea: I wear European S which translate to XXS in the US, but there’s many people skinnier than me, still within a “normal" BMI. Do they have to find XXXS? Do they wear oversized clothes? Choosing trousers is way easier because the system of cm/inches of length+perimeter correspond to real values.

I worked at a Norwegian hospital once which had sizes from xxl (ekstra ekstra liten) to xxs (ekstra ekstra stor). So it's simple, you cross the ocean, you go from size xxl to xxs without having to do anything at all...

I should say though, that's the only place I've seen this particular localization.

Re: Big LLMs weights are a piece of history

#194

Post by vintermann »

tbrownaw wrote: post #182
aziaziazi wrote: post #96

Earlier quoted context omitted.

I wonder how does the skinnies get dressed oversea: I wear European S which translate to XXS in the US, but there’s many people skinnier than me, still within a “normal" BMI. Do they have to find XXXS? Do they wear oversized clothes? Choosing trousers is way easier because the system of cm/inches of length+perimeter correspond to real values.

> Choosing trousers is way easier because the system of cm/inches of length+perimeter correspond to real values. They're not merely real values, they're also rational.

I'm not so sure, there's pi involved here!

Re: Big LLMs weights are a piece of history

#195

Post by kelseydh »

ttul wrote: post #66
dr_dshiv wrote: post #64

“We should regard the Internet Archive as one of the most valuable pieces of modern history; instead, many companies and entities make the chances of the Archive to survive, and accumulate what otherwise will be lost, harder and harder. I understand that the Archive headquarters are located in what used to be a church: well, there is no better way to think of it than as a sacred place.” Amen. There is an active effor…

Well, it did establish a new HQ in Canada… https://vancouversun.com/news/local-news/the-internet-archiv... (Edited: apparently just a new HQ and not THE HQ)

I was looking to a book a wedding in this venue (The Permanent) and the Internet Archive server is prominently visible on the 2nd floor. The server is pretty cool and adds to the aesthetics of the space.

Re: Big LLMs weights are a piece of history

#196

Post by kelseydh »

dr_dshiv wrote: post #133
badlibrarian wrote: post #76

Earlier quoted context omitted.

Anyone who takes even an hour to audit anything about the Internet Archive will soon come to a very sad conclusion. The physical assets are stored in the blast radius of an oil refinery. They don't have air conditioning. Take the tour and they tell you the site runs slower on hot days. Great mission, but atrociously managed. Under attack for a number of reasons, mostly absurd. But a few are painfully valid.

Their yearly budget is less than the budget of just the SF library system.

What I don't understand is how do they afford the storage costs? Surely it must be pricey to have 70+ petabytes of data that's only growing.

Re: Big LLMs weights are a piece of history

#200

Post by Foobar8568 »

Spivak wrote: post #128
aziaziazi wrote: post #96

Earlier quoted context omitted.

I wonder how does the skinnies get dressed oversea: I wear European S which translate to XXS in the US, but there’s many people skinnier than me, still within a “normal" BMI. Do they have to find XXXS? Do they wear oversized clothes? Choosing trousers is way easier because the system of cm/inches of length+perimeter correspond to real values.

It's a crazy experience being just physically larger than most of the world. Especially when the size on the label carries some implicit shame/judgement. Like I'm skinny, I'm pretty much the lowest weight I can be and not look emaciated / worrying. But when shopping for a skirt in Asian sizes I was a 4XL, and usually an or L-2XL in European sizes. Having to shift my mental space that a US M is the "right" size for me…

Uniqlo sizing looks pretty standard to what we have in Europe...
Post reply on HN