fwiw i've added a summary of the discussion here: https://extraakt.com/extraakts/67d708bc9844db151612d782
Big LLMs weights are a piece of history
101–110 of 222 posts
Re: Big LLMs weights are a piece of history
#102I love the title "Big LLMs" because it means that we are now making a distinction between big LLMs and minute LLMs and maybe medium LLMs. I'd like to propose the we call them "Tall LLMs", "Grande LLMs", and "Venti LLMs" just to be precise.
Big LLM is too long as a name. We should agree on calling them BLLMs. Surely everyone is going to remember what the letters stand for.
I still like Big Data Statistical Model
Re: Big LLMs weights are a piece of history
#103I love the title "Big LLMs" because it means that we are now making a distinction between big LLMs and minute LLMs and maybe medium LLMs. I'd like to propose the we call them "Tall LLMs", "Grande LLMs", and "Venti LLMs" just to be precise.
I'd prefer to see olive sizes get a renaissance. I was always amused by Super Colossal when following my mom around a store as a little kid.
From a random web search, it seems the sizes above Large are: Extra Large, Jumbo, Extra Jumbo, Giant, Colossal, Super Colossal, Mammoth, Super Mammoth, Atlas.
Re: Big LLMs weights are a piece of history
#104Earlier quoted context omitted.
Anyone who takes even an hour to audit anything about the Internet Archive will soon come to a very sad conclusion. The physical assets are stored in the blast radius of an oil refinery. They don't have air conditioning. Take the tour and they tell you the site runs slower on hot days. Great mission, but atrociously managed. Under attack for a number of reasons, mostly absurd. But a few are painfully valid.
I realized recently, who needs torrents? I can get a good rip of any movie right there.
I understand what you describe is prohibited in many jurisdictions, however I’m curious about the technical aspect : in my experience they host the html but often not the assets, especially big pictures and I guess most movies files are bigger that pictures. Do you use a special trick to host/find them?
Re: Big LLMs weights are a piece of history
#105I love the title "Big LLMs" because it means that we are now making a distinction between big LLMs and minute LLMs and maybe medium LLMs. I'd like to propose the we call them "Tall LLMs", "Grande LLMs", and "Venti LLMs" just to be precise.
And the US ‘small’ LLMs will actually be slightly larger than the ‘large’ LLMs in the UK.
It's funny you say that, but when travelling abroad I wondered how Europeans and Japanese stay sufficiently hydrated.
Re: Big LLMs weights are a piece of history
#106Earlier quoted context omitted.
Or 80 years to MVP memex “Vannevar Bush's 1945 article "As We May Think". Bush envisioned the memex as a device in which individuals would compress and store all of their books, records, and communications, "mechanized so that it may be consulted with exceeding speed and flexibility". https://en.m.wikipedia.org/wiki/Memex
The memex was a deterministic device to consult documents - the actual documents. The "LLM" is more like a dumb archivist that came with it (" Yes, see for example that document, it tells you that q=M·k... ").
I grew up with physical encyclopedia, then moved on to Encarta, then Wikipedia dumps and folders full of PDFs. I still prefer curated information repository over chat interfaces or generated summaries. The main goal with the former is to have a knowledge map and keywords graph, so that you can locate any piece of information you may need from the actual source.
Re: Big LLMs weights are a piece of history
#107Isn’t big LLM training data actually the most analogous to the internet archive? Shouldn’t the title be “Big LLM training data is a piece of history”? Especially at this point in history since a large portion of internet data going forward will be LLM generated and not human generated? It’s kind of the last snapshot of human-created content.
Re: Big LLMs weights are a piece of history
#108I love the title "Big LLMs" because it means that we are now making a distinction between big LLMs and minute LLMs and maybe medium LLMs. I'd like to propose the we call them "Tall LLMs", "Grande LLMs", and "Venti LLMs" just to be precise.
Name them like clothing sizes: XXLLM, XLLM, LLM, MLM, SLM, XSLM XXSLM.
[deleted]
Re: Big LLMs weights are a piece of history
#109So large large language model?
Re: Big LLMs weights are a piece of history
#110Earlier quoted context omitted.
I realized recently, who needs torrents? I can get a good rip of any movie right there.
I understand what you describe is prohibited in many jurisdictions, however I’m curious about the technical aspect : in my experience they host the html but often not the assets, especially big pictures and I guess most movies files are bigger that pictures. Do you use a special trick to host/find them?
No. And every video game every made is available for download as well. If you even have to download it: they pride in making many of them playable in browser with just a click.
Copyright issues aside (let's avoid that mess) I was referring to basic technical issues with the site. Design is atrocious, search doesn't work, you can click 50 captures of a site before you find one that actually loads, obvious data corruption, invented their own schema instead of using a standard one and don't enforce it, API is insane and usually broken, uploader doesn't work reliably, don't honor DMCA requests, ask for photo id and passports then leak them ...
It's the worst possible implementation of the best possible idea.