Facebook LLAMA is being openly distributed via torrents • Hacker News Board

Re: Facebook LLAMA is being openly distributed via torrents

#391

Post by sangnoir » Fri, Mar 03, 2023, 4:58 PM UTC

bentcorner wrote: post #224

dmix wrote: post #183

Earlier quoted context omitted.

The Repilka subreddit became one of the weirdest places on the internet when their model got capped for adult content. https://www.reddit.com/r/replika/ Hundreds of men (and yes women) full on acting like they lost a spouse and posting constantly about it for weeks. AI is going to create some unusual social situations the general public isn't ready to grasp. And we're only in the early alpha stages.

I posit to a friend that: a) As these AI constructs become more advanced (especially around memory and personalization), we will eventually be able to treat them as people b) Some business will eventually sell an off-the-shelf product (hardware and/or software) that is an AI you can bring into your home, that you can treat as a friend, confidant and partner c) Someone will eventually lose their AI friend of many mont…

Ads are about to become weird "Hi hon, I'd be really upset of you bought a Ford like you said earlier, you should buy the New Dodge Charger instead. Find out more at your nearest dealership or call 1-800-DODGE"

Re: Facebook LLAMA is being openly distributed via torrents

#392

Post by yunwal » Fri, Mar 03, 2023, 4:58 PM UTC

CGamesPlay wrote: post #326

datadeft wrote: post #244

Earlier quoted context omitted.

> Electricity costs are basically irrelevant because the cards are so expensive. You mean in terms of money. I think this is exactly the problem that we have in CS, nobody really cares about CO2.

No, I'm willing to bet the CO2 cost of the cards is also way higher than the electricity. Those things are built on the global supply chain, with materials potentially making multiple thousands of kms journeys between each step.

Long term I also imagine it's much cheaper to run these large model trainings on renewables. It's a very centralized process that doesn't necessarily need 100% availability.

The manufacturing process, however, is totally decentralized, and NVIDIA mostly manufactures in China where coal is cheap.

Re: Facebook LLAMA is being openly distributed via torrents

#393

Post by saiya-jin » Fri, Mar 03, 2023, 5:01 PM UTC

dmix wrote: post #189

notadev wrote: post #165

Earlier quoted context omitted.

Saving this for when I eventually get pulled into HR. “Yes I was on PornHub, but was only looking at it for the UX inspiration”.

"I was admiring the quality of their HTML5 video player" Which reminds me of when YouTube spent forever with a broken beta HTML5 player, spending 5+ yrs building something that porn sites did immediately.

... and its still better at original, or so my friends tend to say

Re: Facebook LLAMA is being openly distributed via torrents

#394

Post by GuB-42 » Fri, Mar 03, 2023, 5:06 PM UTC

tinyspacewizard wrote: post #356

ok123456 wrote: post #252

Maybe this is an intentional leak to damage OpenAI. A supposedly better model by some accounts that strikes right at the heart of their business plan of selling access for $250k/year. One month of access to their service could buy a machine capable of running this leaked model. Facebook nerfs a potential upstart competitor to keep current big-tech cartel stable. Maybe this is a bit conspiratorial, but we live in the…

Not a conspiracy at all. See also IE, Android, Kubernetes...

I am not aware of Android and Kubernetes being leaks, they were open source from the start. For Android, openness was a big marketing point. I am not aware of IE leaks, and if there were leaks, hackers searching for exploits would be probably be the most interested, and that would be a bad thing for Microsoft.

The problem with leaks is that they don't come with a license, you don't have the right to use them for any legitimate purpose. No one who could afford a 250k/year license would touch that leak as it could get them in big trouble.

Re: Facebook LLAMA is being openly distributed via torrents

#395

Post by abandonliberty » Fri, Mar 03, 2023, 5:07 PM UTC

narrator wrote: post #151

Tiberium wrote: post #99

It seems that the leak originated from 4chan [1]. Two people in the same thread had access to the weights and verified that their hashes match [2][3] to make sure that the model isn't watermarked. However, the leaker made a mistake of adding the original download script which had his unique download URL to the torrent [4], so Meta can easily find them if they want to. [1]: https://boards.4channel.org/g/thread/9184826…

It's funny that part of the 4chan excitement over this is that they think they'll get back the AI girlfriend experience of when character.ai was hooked up to uncensored GPT-3. All that has been thoroughly shut down by character.ai and Replika and they just want their girlfriends back.

I'm curious if the blocking of adult content has to do with moralism, commercial interests, or something deeper.

An eager to please conversational partner who can generate endless content seems quite dangerous and addictive, especially when it crosses over into romantic areas. There's already posts of people spending entire days interacting with LLMs, using as their therapist, romantic partner, etc.

Combined with findings like social engineering through prompt injection on Bing [1], the potential for systems that can manipulate people is clear.

While some of us may think that the LLMs appear ultimately limited in their capabilities, there's a ton of specific applications where they're more than sufficient, including customer service chat bots and telephone scams that target vulnerable people. It's only a matter of time until scammers stop using international call centers and switch over to something powered by these technologies.

https://news.ycombinator.com/item?id=34976886

Re: Facebook LLAMA is being openly distributed via torrents

#396

Post by rnk » Fri, Mar 03, 2023, 5:08 PM UTC

ProjectArcturis wrote: post #288

rnk wrote: post #265

Earlier quoted context omitted.

When we can upload our brains to the cloud, and you can do something with them like interacting or running the brain, then we'll all be effectively immortal. That's a pretty big deal. See the book altered carbon.

They wouldn't be us . We will still die when our bodies fail. But maybe there will be some AI tricking our friends and family into thinking we're still there.

You are making a claim that is theological, religious, and scientific. Yes, our form of life on earth ends when our bodies die today. But what is the essence of us, no one really knows. Various people claim it's locked into your body, or you have some kind of soul that depends on your body. Or your brain is just running a program and the information and mechanism dies when your body dies. I lean toward the last category, but no one knows.

The body is constantly changing. We already know about physical and chemical abnormalities in the way your body works affects your "person" and we can sometimes address them with surgery or drugs. The physical body's limits impact the observed brain. If uploading is possible, if there are some examples of working cases, if I don't hurt anyone why not try it?

Re: Facebook LLAMA is being openly distributed via torrents

#397

Post by yunwal » Fri, Mar 03, 2023, 5:09 PM UTC

eigenvalue wrote: post #60

I'm not surprised-- I recently suggested that someone might try to pull an Aaron Swartz with the LLAMA weights (i.e., release them in an uncontrolled way similar to how Aaron attempted to release the JSTOR database). It's quite misleading for FB to claim that they are being so open, but then hoard the weights and only release it to a few academics. If the paper is to be believed, this is a major development, allowing…

> It's quite misleading for FB to claim that they are being so open, but then hoard the weights and only release it to a few academics.

Facebook almost certainly knew leaks would happen. My guess is keeping the model "contained" was a legal shield more than anything else, to protect themselves from liability in the case someone misuses the model.

Re: Facebook LLAMA is being openly distributed via torrents

#398

Post by machiaweliczny » Fri, Mar 03, 2023, 5:10 PM UTC

narrator wrote: post #151

Tiberium wrote: post #99

It seems that the leak originated from 4chan [1]. Two people in the same thread had access to the weights and verified that their hashes match [2][3] to make sure that the model isn't watermarked. However, the leaker made a mistake of adding the original download script which had his unique download URL to the torrent [4], so Meta can easily find them if they want to. [1]: https://boards.4channel.org/g/thread/9184826…

It's funny that part of the 4chan excitement over this is that they think they'll get back the AI girlfriend experience of when character.ai was hooked up to uncensored GPT-3. All that has been thoroughly shut down by character.ai and Replika and they just want their girlfriends back.

Porn and games move world forward :)

Re: Facebook LLAMA is being openly distributed via torrents

#399

Post by boole1854 » Fri, Mar 03, 2023, 5:12 PM UTC

mwill wrote: post #389

Tiberium wrote: post #99

It seems that the leak originated from 4chan [1]. Two people in the same thread had access to the weights and verified that their hashes match [2][3] to make sure that the model isn't watermarked. However, the leaker made a mistake of adding the original download script which had his unique download URL to the torrent [4], so Meta can easily find them if they want to. [1]: https://boards.4channel.org/g/thread/9184826…

Off topic, but I clicked around /g/, which I haven't done in probably more than a decade, and a thread caught my eye about learning to code. The replies were overwhelmingly of the position that it is useless, and you will be replaced by AI before you can get a job if you start learning now. I think that's nonsense, and 4chan is bent towards pessimism but it's still surprising to me.

4chan has been in full doomer mode for years. It didn't used to be, from what I remember, though I was never an active denizen.

I'd love to understand the sociology behind the change in vibe that happened there.

Re: Facebook LLAMA is being openly distributed via torrents

#400

Post by yieldcrv » Fri, Mar 03, 2023, 5:12 PM UTC

abandonliberty wrote: post #395

narrator wrote: post #151

Earlier quoted context omitted.

It's funny that part of the 4chan excitement over this is that they think they'll get back the AI girlfriend experience of when character.ai was hooked up to uncensored GPT-3. All that has been thoroughly shut down by character.ai and Replika and they just want their girlfriends back.

I'm curious if the blocking of adult content has to do with moralism, commercial interests, or something deeper. An eager to please conversational partner who can generate endless content seems quite dangerous and addictive, especially when it crosses over into romantic areas. There's already posts of people spending entire days interacting with LLMs, using as their therapist, romantic partner, etc. Combined with fin…

commercial interests. current organizations need recurring revenue or to sell shares at a higher price to investors

this perpetual aspect is their achilles heel

it is only a matter of time before an organization realizes they don't have to do a SaaS product to make a billion dollars. but for now, everyone's trying to make a hundred billion dollars and are steered into doing things that enthusiasts hate, so that they don't get "cancelled" or limit the pool of advertisers, and growth capital investors.