Live data from Hacker News

Facebook LLAMA is being openly distributed via torrents

github.com

671–680 of 719 posts

Re: Facebook LLAMA is being openly distributed via torrents

#671

Earlier quoted context omitted.

Why leak it instead of just publishing it along with a press release about openness and democratizing AI and so on?

because then you don't need to explain to shareholders why you're giving away something that could potentially be worth a few hundred million dollars.

"Potentially" is doing a lot of work here. I'd say that the trained model is worth approximately as much as the electricity that was required to train it.

Re: Facebook LLAMA is being openly distributed via torrents

#673

Earlier quoted context omitted.

> b) Some business will eventually sell an off-the-shelf product And by sell you mean a monthly subscription, ha ha.

Yeah, that's probably the most dystopian thing. This is almost a guaranteed outcome - someone pays a high subscription cost and cultivates a model with their personal details for years, and then loses all of it when they can't keep up the subscription cost. Cue a month or two later - they buy back in and their model has been wiped and their AI friend now knows nothing about them. It's easy to poke fun at people who u…

Replika's a good example of how a subscription model can go really wrong.

Re: Facebook LLAMA is being openly distributed via torrents

#675

Earlier quoted context omitted.

So since making that comment I managed to get 65B running on 1 x A100 80GB using 8-bit quantization. Though I did need ~130GB of regular RAM on top of it.

So is the model any good?

It seems to be about as good as gpt3-davinci. I've had it generate React components and write crappy poetry about arbitrary topics. Though as expected, it's not very good at instructional prompts since it's not tuned for instruction.

People are also working on adding extra samplers to FB's inference code, I think a repetition penalty sampler will significantly improve quality.

The 7B model is also fun to play with, I've had it generate Youtube transcriptions for fictional videos and it's generally on-topic.

Re: Facebook LLAMA is being openly distributed via torrents

#676

Earlier quoted context omitted.

Saving this for when I eventually get pulled into HR. “Yes I was on PornHub, but was only looking at it for the UX inspiration”.

Porn sites have some of the best and some of the worst coding. Both are very useful to study.

I remember that PornHub had for a brief moment in 2022 a PHP issue in the production site -- every comment was rendered with a closing PHP tag somewhere in it's content to the client (?>).

Re: Facebook LLAMA is being openly distributed via torrents

#677

Earlier quoted context omitted.

Is this supposed to be about activation lock? Phones don't contain a T2, that's a brand name for a component of Intel Macs. And of course it's good for phones to make them worthless to steal, or else they'd be hard to use in public.

I'm specifically talking about the T2 chips in the laptops. The newest Macbooks can be activation-locked, just like the phones. This has already bitten legitimate owners who are trying to restore backup images, etc.

Legislation needs to step in to make it illegal for corporations to prevent resale. If I have a piece of hardware in my hands it is mine. It should ALWAYS be possible to access it. If Full Disk Encryption is used then there should be a button to reset it and start over.

Re: Facebook LLAMA is being openly distributed via torrents

#678

Earlier quoted context omitted.

I'd want an uncensored GPT-3 too and I don't want an AI girlfriend - I just find that chatgpt has too much moral censorship to be fun to use. Want to ask about a health condition? Nope, forbidden. Have a question related to IT security? That's a big no-no. Anything remotely sexual even in educational context? No can do. Yesterday I finished watching a TV show about French intelligence and asked it to recommend some g…

Neglecting to give consideration to the reasons for these limitations is a sign that you might have some low hanging fruit to pick off the ethical and morality trees of knowledge.

If you want anyone to listen to you then try talking like a normal person instead of an unhinged preacher.

Re: Facebook LLAMA is being openly distributed via torrents

#679
post #456

Earlier quoted context omitted.

I bet soon after the first few people are made immortal this way, one of them will hack the banks, or the stock market, or countless other organizations.

And then you'd have the first court case and prison sentence for a non-human consciousness. Which is just one step closer to the simulated hell for uploaded consciousnesses that get naughty, from Surface Detail by Ian Banks.

The show upload on amazon prime is basically this world. If you don't have as much money your instance can pause. You pay more money and have access to nicer things in the afterlife.

Re: Facebook LLAMA is being openly distributed via torrents

#680

Earlier quoted context omitted.

But even if you could copyright them, once you do some fine-tuning, they are not the same model weights!

that would be a derivative work

You mean like how the model itself is a derivative work of tons of copyrighted content? If the original model can sidestep the issue of being trained on copyrighted content, then it should be fair game to train a new model off of a copyrighted model.
Post reply on HN