Facebook LLAMA is being openly distributed via torrents

Post by shagie » Fri, Mar 03, 2023, 5:26 PM UTC

ben_w wrote: post #368

beepbooptheory wrote: post #354

Earlier quoted context omitted.

I dont know if I understand this general take I see a lot. Why care about this "AI personhood" at all? What is the tacit endgame everyone is always referencing with this? Isn't there just so many more both interesting and problematic aspects already here? What is the use of diverting the focus to some other point. "I see you are talking about cows, but I have thoughts about the ocean."

If AI are sentient and we think they aren't… the term “zombie” was created by slaves in the Caribbean who were afraid that even death would not free them from their servitude. This would be the genuine existence of AI which were conscious but which we denied. If we have the opposite scenario in both details, where we think AI are sentient when they're not… at some point, brain scans and uploads will be a thing and th…

Post by fear_and_coffee » Fri, Mar 03, 2023, 5:33 PM UTC

Cipater wrote: post #401

Tiberium wrote: post #99

It seems that the leak originated from 4chan [1]. Two people in the same thread had access to the weights and verified that their hashes match [2][3] to make sure that the model isn't watermarked. However, the leaker made a mistake of adding the original download script which had his unique download URL to the torrent [4], so Meta can easily find them if they want to. [1]: https://boards.4channel.org/g/thread/9184826…

Why do 4chan users go out of their way to be so offensive in their posts?

Post by fear_and_coffee » Fri, Mar 03, 2023, 5:35 PM UTC

causi wrote: post #170

pas wrote: post #128

Earlier quoted context omitted.

... how is that a good test of anything? I mean what if I click on a /b/ link "at work"? Does that make my work output immediately tainted and the company has to immediately file for bankruptcy?

I'd fire somebody for browsing 4chan at work. Shitting dick nipples, lolicon, and the occasional piece of child pornography does not need to be moving over our network.

Post by unhammer » Fri, Mar 03, 2023, 5:42 PM UTC

sebzim4500 wrote: post #24

Is there anything stopping anyone from using this for commercial purposes? I know that when you fill in the google form you need to agree to noncommercial use, but someone downloading this will never have agreed to that licence agreement.

Post by riku_iki » Fri, Mar 03, 2023, 5:45 PM UTC

nodja wrote: post #93

krisoft wrote: post #73

Earlier quoted context omitted.

> It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. I was trying to come to grasp with how much resource there is concentrated in one of these models. Somehow I come to the conclusion that it cost more than buying a jet airliner to train one of these models. And it is about the same order of money as commissi…

For anyone curious, it took 2048 A100 GPUs to train LLaMa, each GPU costs roughly $15k, facebook probably gets some sort of discount. That's a $30Mil if you want to train at that scale. Also IIRC it took 23 days to train the biggest model. Someone else can do the power consumption cost calculations.