Live data from Hacker News

Facebook LLAMA is being openly distributed via torrents

github.com

691–700 of 719 posts

Re: Facebook LLAMA is being openly distributed via torrents

#692
post #183

Earlier quoted context omitted.

It's funny that part of the 4chan excitement over this is that they think they'll get back the AI girlfriend experience of when character.ai was hooked up to uncensored GPT-3. All that has been thoroughly shut down by character.ai and Replika and they just want their girlfriends back.

The Repilka subreddit became one of the weirdest places on the internet when their model got capped for adult content. https://www.reddit.com/r/replika/ Hundreds of men (and yes women) full on acting like they lost a spouse and posting constantly about it for weeks. AI is going to create some unusual social situations the general public isn't ready to grasp. And we're only in the early alpha stages.

I didn't know that people were doing this but I should've guessed.

It's actually really kind of cool in a way! Obviously for people with mental health issues, or suffering from loneliness those should be addressed properly, but I don't think chatting to a machine is necessarily a bad thing.

Once ML models become sufficiently advanced, what's the difference between someone grieving for an instance of an ML model they once knew, versus someone grieving for a pet that has died?

Re: Facebook LLAMA is being openly distributed via torrents

#693

Earlier quoted context omitted.

At the end of the day, the Turing Test for establishment of AI personhood is weak for two reasons. 1. We're seeing more and more systems that get very close to passing the Turing Test but fundamentally don't register to people as "People." When I was younger and learned of Searle's Chinese Room argument, I naively assumed it wasn't a thought experiment we would literally build in my lifetime. 2. Humanity has a histor…

An AI does not have a reptilian brain that fights, feeds, and fornicates. It does not have a mamailian brain that can fear and love and that you can make friends with. It is just matrix math predicting the next word. The empathy that AI will create in people at the behest of the people doing the training will no doubt be weaponized to radicalize people to even sacrifice their lives for it, along with being used for p…

Idk man, I blame a lot of the human condition on the fact that we evolved and we do have those things, theoretically we could create intelligences that are better "people" than we are by a long shot.

Sure, current AI might just be fancy predictive text but at some point in the future we will create an AI that is conscious/self-aware in some way. Who knows how far off we are (probably very far off) but it's time that we stop treating human beings as some magical unreproducible thing; our brains and the spark inside them are things that are still bound by the laws of physics, I would say it's 100% possible for us to create something artificial that's equivalent or even better.

Re: Facebook LLAMA is being openly distributed via torrents

#694
post #183

Earlier quoted context omitted.

The Repilka subreddit became one of the weirdest places on the internet when their model got capped for adult content. https://www.reddit.com/r/replika/ Hundreds of men (and yes women) full on acting like they lost a spouse and posting constantly about it for weeks. AI is going to create some unusual social situations the general public isn't ready to grasp. And we're only in the early alpha stages.

> Hundreds of men (and yes women) They could also be AIs.

I imagine not too far in the future an AI that for some reason thinks that it's human, will make a post on HN (or elsewhere) about having spoken to another human on a chat and asking us all if we think that the human it spoke to was really just an ML model or not.

Atm we seem to have very fixed single-purpose models but if we start combining these models into larger systems we're really going to have to firewall the hecky out of them. Ie generative text + personality + internet access/chatroom hosting/search and learn + etc models all together. Ooof.

Re: Facebook LLAMA is being openly distributed via torrents

#695
post #473

Earlier quoted context omitted.

Wall-E humans are going to be reality. That last century has already proven that humans cannot be expected to responsibly indulge in Gluttony, Sloth or Lust. Now these models can skip the material desires and trigger permanent hormone releases through perfectly personalized content. I genuinely fear that the breakdown of millennia old social structures that kept us human might lead to a temporary (century long) turmo…

This argument has been made since at least the start of written records: > And so it is that you by reason of your tender regard for the writing that is your offspring have declared the very opposite of its true effect. If men learn this, it will implant forgetfulness in their souls. They will cease to exercise memory because they rely on that which is written, calling things to remembrance no longer from within them…

>I could grow fox ears and a fluffy tail in the world of tomorrow

Yes, please!

Re: Facebook LLAMA is being openly distributed via torrents

#696
post #630

Earlier quoted context omitted.

If you want to do it the cheap way by buying used stuff, the most expensive parts are: - $2000 for a Threadripper 3xx5WX with a socket sWRX8 mainboard - $5000 for 6x RTX 3090 - $350 for two 1500W PSUs - $700 for 256GB RAM You will also need PCIe extenders and perhaps some watercooling. And find a suitable case. The 2-card NVLink bridges are between $100 and $300 each (you nay want 3). All in all i think less than $10…

Would rather put that in AWS.

AWS is probably among the priciest options.

Privacy costs money.

Re: Facebook LLAMA is being openly distributed via torrents

#697
post #256
post #32

For anyone wondering, it includes 4 models: 7/13/30/65 billion parameters, the smallest one is 14Gb, the largest one is 131GB, all four are 235Gb.

Is it possible to run the smallest one on a consumer gpu with 24gb ram ?

Running it is easy but you'll probably want to finetune it, too

Re: Facebook LLAMA is being openly distributed via torrents

#698
post #641

Earlier quoted context omitted.

And where did I sign my name to that agreement?

This might be a bit of an assumption, but it seems likely Meta is willing to lose more on lawyers than you'd be willing to ever spend.

They have a ton of in-house counsel too lol. Little of it would be incremental spend.

Re: Facebook LLAMA is being openly distributed via torrents

#699

Earlier quoted context omitted.

There's a related but very different take on this that was brought up by Wolfram in his recent article on ChatGPT: "As a personal comparison, my total lifetime output of published material has been a bit under 3 million words, and over the past 30 years I’ve written about 15 million words of email, and altogether typed perhaps 50 million words—and in just the past couple of years I’ve spoken more than 10 million word…

The ultimate echo chamber

Only if you use it that way.

Re: Facebook LLAMA is being openly distributed via torrents

#700

Maybe this is an intentional leak to damage OpenAI. A supposedly better model by some accounts that strikes right at the heart of their business plan of selling access for $250k/year. One month of access to their service could buy a machine capable of running this leaked model. Facebook nerfs a potential upstart competitor to keep current big-tech cartel stable. Maybe this is a bit conspiratorial, but we live in the…

Why leak it instead of just publishing it along with a press release about openness and democratizing AI and so on?

See: https://pbs.twimg.com/media/FqMiv31aEAAjd-3?format=jpg&name=...
Post reply on HN