Facebook LLAMA is being openly distributed via torrents • Hacker News Board

Re: Facebook LLAMA is being openly distributed via torrents

#221

Post by dmix » Fri, Mar 03, 2023, 2:34 PM UTC

zb3 wrote: post #78

londons_explore wrote: post #61

Earlier quoted context omitted.

They could contain arbitrary code... But typically do not. That means that with the right viewer application it will be trivial to know for sure. It isn't like a multi gigabyte game for example, where knowing if there is any malicious code could easily be a multi-month reverse engineering project to get to the answer of 'probably not, but we don't have time to check every byte with a fine tooth comb'

I only found this picklescan[0] serving this purpose, but it doesn't seem to be a finished project. [0] - https://github.com/mmaitre314/picklescan

Curious how long that would take on 200gb.

Re: Facebook LLAMA is being openly distributed via torrents

#222

Post by ithkuil » Fri, Mar 03, 2023, 2:35 PM UTC

ot wrote: post #211

ithkuil wrote: post #173

Earlier quoted context omitted.

> and have no internal information on this But you just said it was not Meta. Is that based on internal information? ;-)

As I explained in another comment, if the author was a Meta employee, they wouldn't have had to sign the CLA. It's all in the PR.

I wondered why I didn't see that comment of yours. Turns out the comment you replied to got flagged.

Re: Facebook LLAMA is being openly distributed via torrents

#223

Post by binarymax » Fri, Mar 03, 2023, 2:35 PM UTC

Has anyone managed to download this yet using the magnet link? Is it well seeded?

Re: Facebook LLAMA is being openly distributed via torrents

#224

Post by bentcorner » Fri, Mar 03, 2023, 2:36 PM UTC

dmix wrote: post #183

narrator wrote: post #151

Earlier quoted context omitted.

It's funny that part of the 4chan excitement over this is that they think they'll get back the AI girlfriend experience of when character.ai was hooked up to uncensored GPT-3. All that has been thoroughly shut down by character.ai and Replika and they just want their girlfriends back.

The Repilka subreddit became one of the weirdest places on the internet when their model got capped for adult content. https://www.reddit.com/r/replika/ Hundreds of men (and yes women) full on acting like they lost a spouse and posting constantly about it for weeks. AI is going to create some unusual social situations the general public isn't ready to grasp. And we're only in the early alpha stages.

I posit to a friend that:

a) As these AI constructs become more advanced (especially around memory and personalization), we will eventually be able to treat them as people

b) Some business will eventually sell an off-the-shelf product (hardware and/or software) that is an AI you can bring into your home, that you can treat as a friend, confidant and partner

c) Someone will eventually lose their AI friend of many months/years through some failure (subscription lapse, hardware failure, theft, etc.)

d) Shits about to get real weird, real fast

Re: Facebook LLAMA is being openly distributed via torrents

#225

Post by m3kw9 » Fri, Mar 03, 2023, 2:37 PM UTC

pavlov wrote: post #41

It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. This has not been the case for most commercial software for the past 20 years, during the cloud era. If you could steal a dump of random Facebook source code, it would be 99% useless because it’s so closely tied to the infrastructure. There’s almost nothing yo…

The config itself would be enough to lock anyone out

Re: Facebook LLAMA is being openly distributed via torrents

#226

Post by dmix » Fri, Mar 03, 2023, 2:38 PM UTC

optimalsolver wrote: post #119

Tiberium wrote: post #100

Earlier quoted context omitted.

The original 4chan thread seems to indicate that the leaker verified that his hashes matched with another person who had access to the weights, to make sure that the weights aren't watermarked [0] 0: https://boards.4channel.org/g/thread/91848262#p91849855

The leaker accidentally doxxed themselves by adding the original download script to the torrent: https://boards.4channel.org/g/thread/91848262#p91850503

What are the possible consequences here?

Re: Facebook LLAMA is being openly distributed via torrents

#227

Post by unethical_ban » Fri, Mar 03, 2023, 2:38 PM UTC

Let's say I wanted to use this for... whatever. How do I do it? I bookmarked some "AI for beginners" youtube videos.

No, I'm not trolling. The jargon and the ideas around LLMs is completely foreign to me. I have no idea how they work.

Re: Facebook LLAMA is being openly distributed via torrents

#228

Post by DharmaPolice » Fri, Mar 03, 2023, 2:39 PM UTC

bentcorner wrote: post #224

dmix wrote: post #183

Earlier quoted context omitted.

The Repilka subreddit became one of the weirdest places on the internet when their model got capped for adult content. https://www.reddit.com/r/replika/ Hundreds of men (and yes women) full on acting like they lost a spouse and posting constantly about it for weeks. AI is going to create some unusual social situations the general public isn't ready to grasp. And we're only in the early alpha stages.

I posit to a friend that: a) As these AI constructs become more advanced (especially around memory and personalization), we will eventually be able to treat them as people b) Some business will eventually sell an off-the-shelf product (hardware and/or software) that is an AI you can bring into your home, that you can treat as a friend, confidant and partner c) Someone will eventually lose their AI friend of many mont…

It became something of a meme but there are huge numbers of guys out there that would pay good money for Joi from Blade Runner 2049.

https://bladerunner.fandom.com/wiki/Joi

Re: Facebook LLAMA is being openly distributed via torrents

#229

Post by bogomipz » Fri, Mar 03, 2023, 2:41 PM UTC

jimbob45 wrote: post #168

narrator wrote: post #151

Earlier quoted context omitted.

It's funny that part of the 4chan excitement over this is that they think they'll get back the AI girlfriend experience of when character.ai was hooked up to uncensored GPT-3. All that has been thoroughly shut down by character.ai and Replika and they just want their girlfriends back.

I’m sure the CAI filter will magically stop filtering as much now that they have actual competition.

What is the CAI filter?

Re: Facebook LLAMA is being openly distributed via torrents

#230

Post by dmix » Fri, Mar 03, 2023, 2:42 PM UTC

bentcorner wrote: post #224

dmix wrote: post #183

Earlier quoted context omitted.

The Repilka subreddit became one of the weirdest places on the internet when their model got capped for adult content. https://www.reddit.com/r/replika/ Hundreds of men (and yes women) full on acting like they lost a spouse and posting constantly about it for weeks. AI is going to create some unusual social situations the general public isn't ready to grasp. And we're only in the early alpha stages.

I posit to a friend that: a) As these AI constructs become more advanced (especially around memory and personalization), we will eventually be able to treat them as people b) Some business will eventually sell an off-the-shelf product (hardware and/or software) that is an AI you can bring into your home, that you can treat as a friend, confidant and partner c) Someone will eventually lose their AI friend of many mont…

Reminds me of Ray Kurizwell's obsession with uploading brains to the cloud to get back his beloved father.