Earlier quoted context omitted.
Why leak it instead of just publishing it along with a press release about openness and democratizing AI and so on?
because then you don't need to explain to shareholders why you're giving away something that could potentially be worth a few hundred million dollars.
Facebook LLAMA is being openly distributed via torrents
671–680 of 719 posts
Re: Facebook LLAMA is being openly distributed via torrents
#672Re: Facebook LLAMA is being openly distributed via torrents
#673Earlier quoted context omitted.
> b) Some business will eventually sell an off-the-shelf product And by sell you mean a monthly subscription, ha ha.
Yeah, that's probably the most dystopian thing. This is almost a guaranteed outcome - someone pays a high subscription cost and cultivates a model with their personal details for years, and then loses all of it when they can't keep up the subscription cost. Cue a month or two later - they buy back in and their model has been wiped and their AI friend now knows nothing about them. It's easy to poke fun at people who u…
Re: Facebook LLAMA is being openly distributed via torrents
#674Re: Facebook LLAMA is being openly distributed via torrents
#675Earlier quoted context omitted.
So since making that comment I managed to get 65B running on 1 x A100 80GB using 8-bit quantization. Though I did need ~130GB of regular RAM on top of it.
So is the model any good?
People are also working on adding extra samplers to FB's inference code, I think a repetition penalty sampler will significantly improve quality.
The 7B model is also fun to play with, I've had it generate Youtube transcriptions for fictional videos and it's generally on-topic.
Re: Facebook LLAMA is being openly distributed via torrents
#676Earlier quoted context omitted.
Saving this for when I eventually get pulled into HR. “Yes I was on PornHub, but was only looking at it for the UX inspiration”.
Porn sites have some of the best and some of the worst coding. Both are very useful to study.
Re: Facebook LLAMA is being openly distributed via torrents
#677Earlier quoted context omitted.
Is this supposed to be about activation lock? Phones don't contain a T2, that's a brand name for a component of Intel Macs. And of course it's good for phones to make them worthless to steal, or else they'd be hard to use in public.
I'm specifically talking about the T2 chips in the laptops. The newest Macbooks can be activation-locked, just like the phones. This has already bitten legitimate owners who are trying to restore backup images, etc.
Re: Facebook LLAMA is being openly distributed via torrents
#678Earlier quoted context omitted.
I'd want an uncensored GPT-3 too and I don't want an AI girlfriend - I just find that chatgpt has too much moral censorship to be fun to use. Want to ask about a health condition? Nope, forbidden. Have a question related to IT security? That's a big no-no. Anything remotely sexual even in educational context? No can do. Yesterday I finished watching a TV show about French intelligence and asked it to recommend some g…
Neglecting to give consideration to the reasons for these limitations is a sign that you might have some low hanging fruit to pick off the ethical and morality trees of knowledge.
Re: Facebook LLAMA is being openly distributed via torrents
#679Earlier quoted context omitted.
I bet soon after the first few people are made immortal this way, one of them will hack the banks, or the stock market, or countless other organizations.
And then you'd have the first court case and prison sentence for a non-human consciousness. Which is just one step closer to the simulated hell for uploaded consciousnesses that get naughty, from Surface Detail by Ian Banks.
Re: Facebook LLAMA is being openly distributed via torrents
#680Earlier quoted context omitted.
But even if you could copyright them, once you do some fine-tuning, they are not the same model weights!
that would be a derivative work