Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Facebook LLAMA is being openly distributed via torrents

github.com

Post reply on HN
Print view View original

101–110 of 719 posts

Re: Facebook LLAMA is being openly distributed via torrents

#101

Post by xuhu »

londons_explore wrote: post #69
pimterry wrote: post #62

I give it a week before we see tools for subtly watermarking your secret LLM's weights, so you can trace leaks like this later.

Watermarking the weights is trivial. Watermarking the output is also possible, but more complex and with a statistical success rate Vs performance tradeoff.

If you find an AI generated response online, and ask GhatGPT if it was the author, it says "it was probably written by a human". But we all know there is a split infinitive here, and an archaic form there, and it knows. But it won't tell us.

Re: Facebook LLAMA is being openly distributed via torrents

#102

Post by causi »

Tiberium wrote: post #99

It seems that the leak originated from 4chan [1]. Two people in the same thread had access to the weights and verified that their hashes match [2][3] to make sure that the model isn't watermarked. However, the leaker made a mistake of adding the original download script which had his unique download URL to the torrent [4], so Meta can easily find them if they want to. [1]: https://boards.4channel.org/g/thread/9184826…

Just a warning to readers, I would not recommend clicking 4chan links while at work.

Re: Facebook LLAMA is being openly distributed via torrents

#103

Post by LilyFrenchPants »

KaiserPro wrote: post #5

old school opensource, which is a bit surprising from meta. I wonder how they managed to square that with legal. Someone must have been very good friends with Zuck.

> old school opensource, which is a bit surprising from meta

Aren't you a cheeky lad? Metea turned out lots of open-source database systems:

* RocksDB

* Hive

* Presto

* Cassandra

* Velox

LFP

Re: Facebook LLAMA is being openly distributed via torrents

#104

Post by candiddevmike »

seydor wrote: post #45
pavlov wrote: post #41

It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. This has not been the case for most commercial software for the past 20 years, during the cloud era. If you could steal a dump of random Facebook source code, it would be 99% useless because it’s so closely tied to the infrastructure. There’s almost nothing yo…

> massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. So, like movies or software

Or a car

Re: Facebook LLAMA is being openly distributed via torrents

#106

Post by version_five »

pavlov wrote: post #41

It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. This has not been the case for most commercial software for the past 20 years, during the cloud era. If you could steal a dump of random Facebook source code, it would be 99% useless because it’s so closely tied to the infrastructure. There’s almost nothing yo…

Finding a sha256 hash with N leading zeros is basically arbitrarily computationally expensive but could be written on a piece of paper. I don't see training an ML model as an egregious example of concentrating compute power

Re: Facebook LLAMA is being openly distributed via torrents

#107

Post by jpeter »

causi wrote: post #102
Tiberium wrote: post #99

It seems that the leak originated from 4chan [1]. Two people in the same thread had access to the weights and verified that their hashes match [2][3] to make sure that the model isn't watermarked. However, the leaker made a mistake of adding the original download script which had his unique download URL to the torrent [4], so Meta can easily find them if they want to. [1]: https://boards.4channel.org/g/thread/9184826…

Just a warning to readers, I would not recommend clicking 4chan links while at work.

Fortune favors the brave

Re: Facebook LLAMA is being openly distributed via torrents

#108

Post by moffkalast »

candiddevmike wrote: post #104
seydor wrote: post #45

Earlier quoted context omitted.

> massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. So, like movies or software

Or a car

But you wouldn't download one. Would you?!?

Re: Facebook LLAMA is being openly distributed via torrents

#109

Post by moffkalast »

px43 wrote: post #53
zb3 wrote: post #50

Earlier quoted context omitted.

But ML models generally can execute arbitrary code Is it the case if we're only talking about weights? I thought the rest is actually "open".

My understanding is that weights are normally stored as pickled python blobs, which means arbitrary code execution as they are unpickled.

"They turned the model into a pickle? Funniest shit I've ever seen."

But seriously, why not something more human readable and text-based if it's just weights?

Re: Facebook LLAMA is being openly distributed via torrents

#110

Post by greggsy »

version_five wrote: post #106
pavlov wrote: post #41

It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. This has not been the case for most commercial software for the past 20 years, during the cloud era. If you could steal a dump of random Facebook source code, it would be 99% useless because it’s so closely tied to the infrastructure. There’s almost nothing yo…

Finding a sha256 hash with N leading zeros is basically arbitrarily computationally expensive but could be written on a piece of paper. I don't see training an ML model as an egregious example of concentrating compute power

It’s not the power they’re referring to, it’s the density of information and effort that went into its creation.
Post reply on HN