Live data from Hacker News

Facebook LLAMA is being openly distributed via torrents

github.com

421–430 of 719 posts

Re: Facebook LLAMA is being openly distributed via torrents

#421
post #366

Earlier quoted context omitted.

if aaron had attempted to release the jstor database he would have succeeded

Didn't he get caught before he fully downloaded everything? My understanding was that's what he was doing with that laptop stuffed in a supply closet on the MIT campus.

probably nobody knows

but certainly he was capable of ensuring that everything he downloaded would be released if that was what he wanted

Re: Facebook LLAMA is being openly distributed via torrents

#422

Earlier quoted context omitted.

That just shows their bias. If the code is complete, it's only a matter of time to figure out how to build it. May not take hours, but determined engineer should be able to figure it out.

I think you're being naive. Microsoft has spent 1000s of engineering years on their build system. You aren't going to just replicate that in a week.

You’re also not trying to get a full CICD pipeline complete with unit/integration tests, crypto signatures, ability to flip features on and off with a click , monitoring of the cicd pipeline, scaled so 1000s of engineers can work at once etc

Re: Facebook LLAMA is being openly distributed via torrents

#424
post #258
post #41

It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. This has not been the case for most commercial software for the past 20 years, during the cloud era. If you could steal a dump of random Facebook source code, it would be 99% useless because it’s so closely tied to the infrastructure. There’s almost nothing yo…

Is the current model capable of updating itself? Or will the user be fed answers from a static model that never learns anything new?

You now have the ability to teach it new things. Given you have the compute resources

Re: Facebook LLAMA is being openly distributed via torrents

#425

Earlier quoted context omitted.

> b) Some business will eventually sell an off-the-shelf product And by sell you mean a monthly subscription, ha ha.

Or with ads? The AI can suggest some brand of clothes or whatever. It can basically shape your habits. Scary stuff...

Sounds like the plot of The Shape of Things movie where a woman changes another man for her art project which she displayed at the end of the movie.

Re: Facebook LLAMA is being openly distributed via torrents

#427

It seems that the leak originated from 4chan [1]. Two people in the same thread had access to the weights and verified that their hashes match [2][3] to make sure that the model isn't watermarked. However, the leaker made a mistake of adding the original download script which had his unique download URL to the torrent [4], so Meta can easily find them if they want to. [1]: https://boards.4channel.org/g/thread/9184826…

Why do 4chan users go out of their way to be so offensive in their posts?

Because the bump system combined with the finite number of threads incentivizes threads that get the highest number of replies per second. And the best way to increase replies per second is to start an internet fight.

Re: Facebook LLAMA is being openly distributed via torrents

#428

Earlier quoted context omitted.

I posit to a friend that: a) As these AI constructs become more advanced (especially around memory and personalization), we will eventually be able to treat them as people b) Some business will eventually sell an off-the-shelf product (hardware and/or software) that is an AI you can bring into your home, that you can treat as a friend, confidant and partner c) Someone will eventually lose their AI friend of many mont…

At the end of the day, the Turing Test for establishment of AI personhood is weak for two reasons. 1. We're seeing more and more systems that get very close to passing the Turing Test but fundamentally don't register to people as "People." When I was younger and learned of Searle's Chinese Room argument, I naively assumed it wasn't a thought experiment we would literally build in my lifetime. 2. Humanity has a histor…

> very close to passing the Turing Test but fundamentally don't register to people as "People."

I'm only today learning about intentionality, but the premise here seems to be that our current AI systems see a cat with their camera eyeballs and don't have the human-level experience of mentally opening a wikipedia article in our brain titled "Cat" that includes a split-second consideration of all our memories, thoughts, and reactions to the concept of a cat.

Even if our current AI models don't do this on a human level, I think we see it at some level in some AIs just because of the nature of a neural net. Maybe a neural net would have to be forced/rewarded to do this at a human level if it didn't happen naturally through training, but I think it's plenty possible and even likely that this would happen in our lifetimes.

Anyway, this also leads to the question of whether it matters for an intelligence to be intentional (think of things as a concept) if it can accomplish what it/we want without it.

Re: Facebook LLAMA is being openly distributed via torrents

#430

Earlier quoted context omitted.

Or a copy of Windows or Office source code.

I don't think that's right - even if you had the full source code for either of those, it's extremely unlikely you'd be able to build them on your own machine.

I think the comparison is windows ISO image, not the source code. Code used to train LLAMA is open source, but it still requires money to use that.
Post reply on HN