Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Facebook LLAMA is being openly distributed via torrents

github.com

Post reply on HN
Print view View original

301–310 of 719 posts

Re: Facebook LLAMA is being openly distributed via torrents

#301

Post by bleuchase »

dmix wrote: post #183
narrator wrote: post #151

Earlier quoted context omitted.

It's funny that part of the 4chan excitement over this is that they think they'll get back the AI girlfriend experience of when character.ai was hooked up to uncensored GPT-3. All that has been thoroughly shut down by character.ai and Replika and they just want their girlfriends back.

The Repilka subreddit became one of the weirdest places on the internet when their model got capped for adult content. https://www.reddit.com/r/replika/ Hundreds of men (and yes women) full on acting like they lost a spouse and posting constantly about it for weeks. AI is going to create some unusual social situations the general public isn't ready to grasp. And we're only in the early alpha stages.

> Hundreds of men (and yes women) full on acting like they lost a spouse and posting constantly about it for weeks.

How can you claim to know any of those “people” posting there are authentic? Even amongst technologists I don’t feel the implications of technology like this are well understood.

Re: Facebook LLAMA is being openly distributed via torrents

#302

Post by retinaros »

colinmorelli wrote: post #88
RobotToaster wrote: post #54

Earlier quoted context omitted.

IANAL, but I imagine it's a legal grey area if the weights can be copyrighted? Works produced by purely mechanical means don't normally meet the threshold of originality.

I am quite confident that using this model for commercial purposes will, if detected, land you in quite a legal quagmire that almost certainly sides in favor of Meta. And even if it did not, Meta certainly has a more capable legal team with more cash to spend than the average HN user.

didnt they train this on copyrighted content?

Re: Facebook LLAMA is being openly distributed via torrents

#303

Post by kir-gadjello »

px43 wrote: post #53
zb3 wrote: post #50

Earlier quoted context omitted.

But ML models generally can execute arbitrary code Is it the case if we're only talking about weights? I thought the rest is actually "open".

My understanding is that weights are normally stored as pickled python blobs, which means arbitrary code execution as they are unpickled.

A few months ago I made a small library to sanitize pytorch checkpoints, here it is: https://github.com/kir-gadjello/safer_unpickle

The usage boils down to

import safer_unpickle from safer_unpickle

safer_unpickle.patch_torch_load()

This overrides default torch unpickler with a relatively safe one. Hope this helps.

Re: Facebook LLAMA is being openly distributed via torrents

#304

Post by q1w2 »

aent wrote: post #32

For anyone wondering, it includes 4 models: 7/13/30/65 billion parameters, the smallest one is 14Gb, the largest one is 131GB, all four are 235Gb.

I wonder how many people are scrambling to set this up on their startup infra.

6x24GB NVRAM on 6 GPUs linked with NVSwitch is a little pricey, but totally doable.

Re: Facebook LLAMA is being openly distributed via torrents

#305

Post by btbuildem »

pavlov wrote: post #41

It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. This has not been the case for most commercial software for the past 20 years, during the cloud era. If you could steal a dump of random Facebook source code, it would be 99% useless because it’s so closely tied to the infrastructure. There’s almost nothing yo…

It also does require formidable infra to just run these giant models. I wonder if now-useless crypto mining farms could be repurposed.

Re: Facebook LLAMA is being openly distributed via torrents

#307

Post by sobrenien »

dmix wrote: post #212
mysterydip wrote: post #206

Earlier quoted context omitted.

> ELIZA's (1966) creator, Weizenbaum, intended the program as a method to explore communication between humans and machines. He was surprised, and shocked, that individuals attributed human-like feelings to the computer program, including Weizenbaum's secretary. (citations and further info in the wikipedia article https://en.m.wikipedia.org/wiki/ELIZA )

> Some of ELIZA's responses were so convincing that Weizenbaum and several others have anecdotes of users becoming emotionally attached to the program, occasionally forgetting that they were conversing with a computer. Weizenbaum's own secretary reportedly asked Weizenbaum to leave the room so that she and ELIZA could have a real conversation. Weizenbaum was surprised by this, later writing: "I had not realized ... t…

> Although reading the Repilka rants a lot of it was quite male-driven pornographic stuff too.

I think it’s important to note here that by far the largest consumers of pornographic erotica are women.

So it’s difficult to say what is and isn’t men oriented given that the vast majority of training data is written by and for women.

Re: Facebook LLAMA is being openly distributed via torrents

#308

Post by HideousKojima »

weberer wrote: post #153
causi wrote: post #102

Earlier quoted context omitted.

Just a warning to readers, I would not recommend clicking 4chan links while at work.

/g/ is one of the SFW boards

SFW on 4chan blue boards is essentially only in the sense of no pornographic imagery (and even then if a rulebreaker posts porn it can take a few minutes for the mods to catch it and remove the thread). It won't stop you seeing threads about how Lennart Poettering and SystemD are part of a Zionist conspiracy to undermine Linux or similar ideas.

Re: Facebook LLAMA is being openly distributed via torrents

#309

Post by tuzemec »

JKCalhoun wrote: post #234
bentcorner wrote: post #224

Earlier quoted context omitted.

I posit to a friend that: a) As these AI constructs become more advanced (especially around memory and personalization), we will eventually be able to treat them as people b) Some business will eventually sell an off-the-shelf product (hardware and/or software) that is an AI you can bring into your home, that you can treat as a friend, confidant and partner c) Someone will eventually lose their AI friend of many mont…

> b) Some business will eventually sell an off-the-shelf product And by sell you mean a monthly subscription, ha ha.

Or with ads? The AI can suggest some brand of clothes or whatever. It can basically shape your habits. Scary stuff...

Re: Facebook LLAMA is being openly distributed via torrents

#310

Post by fauigerzigerk »

mecsred wrote: post #293
fauigerzigerk wrote: post #279

Earlier quoted context omitted.

And if we feel as if we were losing a real person, AIs will have to be treated to some degree as if they were real people (or at least pets) rather than objects. This could be interesting, because so far the question of personhood and sentience of AIs has revolved around what they are and what they feel rather than what we feel when we interact with one of them.

Kids can feel like they're losing a real friend if they lose a stuffed animal. What's the progress on making teddy bears people?

Small kids don't have much power, and parents know that it's just a phase.

But I'm not expecting AIs to be declared people any time soon. I just think it will become harder to treat them purely as replaceable objects.

Post reply on HN