LLMs invalidate the concept of copyright to such a degree that I find it impossible to see this torrent as theft.
Facebook LLAMA is being openly distributed via torrents
541–550 of 719 posts
Re: Facebook LLAMA is being openly distributed via torrents
#542Earlier quoted context omitted.
Wall-E humans are going to be reality. That last century has already proven that humans cannot be expected to responsibly indulge in Gluttony, Sloth or Lust. Now these models can skip the material desires and trigger permanent hormone releases through perfectly personalized content. I genuinely fear that the breakdown of millennia old social structures that kept us human might lead to a temporary (century long) turmo…
This argument has been made since at least the start of written records: > And so it is that you by reason of your tender regard for the writing that is your offspring have declared the very opposite of its true effect. If men learn this, it will implant forgetfulness in their souls. They will cease to exercise memory because they rely on that which is written, calling things to remembrance no longer from within them…
> This argument has been made since at least the start of written records:
That argument has been made since only slightly later. The key difference is that this truly is a unique time in history by population numbers. It's also unique in that humans could destroy the biosphere if we wanted to - that was never possible before the mid-20th.
Just because people jumped the gun in the past doesn't mean they are wrong now. The truth is that people are always preaching about the apocalypse, and will continue to do so as long as there are humans, I think. But this does not mean an apocalypse isn't coming. Just like the person who always predicts rain is sometimes right.
Re: Facebook LLAMA is being openly distributed via torrents
#543Earlier quoted context omitted.
With code modifications, it should be possible to run this with a very modest machine as long as you're happy for performance to suck. Transformer models typically need to read all the weights per 'word' output, so if your model is 20GB and you have not enough ram or vram, but have an SSD that reads 1GB/sec, expect 3 words per minute output speed. However, code changes are necessary to achieve that, although they won…
Why 3 words per minute as opposed to second? Is that a typo? If you have enough RAM (but not VRAM), does it basically become limited by the PCIE lanes? So for the 112GB model with a Gen 5 GPU (64 GB/s PCIE bandwidth) that would be roughly 2 seconds per word right?
If read is 1GB/s then it takes 20s to infer across a 20GB model. That's 3 tokens a minute.
Re: Facebook LLAMA is being openly distributed via torrents
#544I'm not surprised-- I recently suggested that someone might try to pull an Aaron Swartz with the LLAMA weights (i.e., release them in an uncontrolled way similar to how Aaron attempted to release the JSTOR database). It's quite misleading for FB to claim that they are being so open, but then hoard the weights and only release it to a few academics. If the paper is to be believed, this is a major development, allowing…
"It's quite misleading for FB to claim that they are being so open, but then hoard the weights and only release it to a few academics."
I don't think it's misleading. Even saying that Facebook "hoards" the weights when they are more open than any other major AI company is baffling.
Re: Facebook LLAMA is being openly distributed via torrents
#545Earlier quoted context omitted.
Now that I think about it I wonder why we don't see it being used to distribute packages for linux distros. Seems more flexible than the current mirror system.
More overhead, torrents being blocked or disliked because of their association with piracy, difficulty to distribute updated versions of files (package indexes)?
Game consoles use torrent protocols to distribute game updates.
Re: Facebook LLAMA is being openly distributed via torrents
#546[deleted]
Re: Facebook LLAMA is being openly distributed via torrents
#547Earlier quoted context omitted.
Why do 4chan users go out of their way to be so offensive in their posts?
Because it's really the onlY place left to go if you want to be offensive. First forums, then platforms censored offensive people out of their niche places. Even Cloudflare participates. 4chan remains the only privately owned large forum.
> Even Cloudflare participates.
4chan is hosted by Cloudflare
Re: Facebook LLAMA is being openly distributed via torrents
#548It seems that the leak originated from 4chan [1]. Two people in the same thread had access to the weights and verified that their hashes match [2][3] to make sure that the model isn't watermarked. However, the leaker made a mistake of adding the original download script which had his unique download URL to the torrent [4], so Meta can easily find them if they want to. [1]: https://boards.4channel.org/g/thread/9184826…
It would be interesting if there was a WikiLeaks-type of organization that facilitates safely leaking large models from big corporations.
Not sure how that would play out for accelerationism and existential risk, but I certainly don't trust the current powers that be.
Re: Facebook LLAMA is being openly distributed via torrents
#549Earlier quoted context omitted.
Electricity costs are basically irrelevant because the cards are so expensive. A100 cards consume 250w each, with datacenter overheads we will call it 1000 kilowatts for all 2048 cards. 23 days is 552 hours, or 552,000 kilowatt hours total. Most dataceneters are between 7 and 10 cents per kilowatt hour for electricity. Some are below 4. At 10 cents, that's $53,000 in electricity costs, which is nothing next to $30 mi…
> Electricity costs are basically irrelevant because the cards are so expensive. You mean in terms of money. I think this is exactly the problem that we have in CS, nobody really cares about CO2.
AWS us-west-2 is housed in The Dalles and Prineville, Oregon. Not only are they near a massive wind farm in the Columbia Gorge, but also quite near the Columbia river's many hydro-electric dams. Facebook and Apple also have Prineville data centers. They are built there intentionally. Electricity at many data centers is quite carbon-lean.
Re: Facebook LLAMA is being openly distributed via torrents
#550Earlier quoted context omitted.
Isn't the "preview" function in timeline ripped straight off porno sites too ?
I mean, I'm pretty sure DVD players had it when FF/Rewinding first.
Older even! The industry term is "trick play" or "trick mode", although I'm not sure where the name comes from: https://en.wikipedia.org/wiki/Trick_mode