Live data from Hacker News

Facebook LLAMA is being openly distributed via torrents

github.com

71–80 of 719 posts

Re: Facebook LLAMA is being openly distributed via torrents

#71

Earlier quoted context omitted.

Sure I'll download TeamMysticAvengers-meta-llm-x-cars-movie-model-x-angelina-jolie-naked-xxx-2023.zip.exe.torrent

Just a sec, need to find the crack on astalavista

Or a keygen with this soundtrack: https://youtube.com/watch?v=foYc1cVkyKk

Re: Facebook LLAMA is being openly distributed via torrents

#72
post #41

It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. This has not been the case for most commercial software for the past 20 years, during the cloud era. If you could steal a dump of random Facebook source code, it would be 99% useless because it’s so closely tied to the infrastructure. There’s almost nothing yo…

If you were to steal a chunk of source code or a binary from meta/Google, you could probably get it running inside a few weeks effort. Sure, the binary probably depends on a lot of internal proprietary infrastructure, but also most of that infrastructure is easy to write a mock implementation of, as long as you are happy for it to be in-ram, not multi-homed and don't need it to scale to billions of users. Most of the…

[deleted]

Re: Facebook LLAMA is being openly distributed via torrents

#73
post #41

It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. This has not been the case for most commercial software for the past 20 years, during the cloud era. If you could steal a dump of random Facebook source code, it would be 99% useless because it’s so closely tied to the infrastructure. There’s almost nothing yo…

> It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent.

I was trying to come to grasp with how much resource there is concentrated in one of these models. Somehow I come to the conclusion that it cost more than buying a jet airliner to train one of these models. And it is about the same order of money as commissioning and building a skyscraper in Manhattan. Is that correct approximately?

Re: Facebook LLAMA is being openly distributed via torrents

#74

I'm not surprised-- I recently suggested that someone might try to pull an Aaron Swartz with the LLAMA weights (i.e., release them in an uncontrolled way similar to how Aaron attempted to release the JSTOR database). It's quite misleading for FB to claim that they are being so open, but then hoard the weights and only release it to a few academics. If the paper is to be believed, this is a major development, allowing…

>Clearly some renegade academic feels the same way.

Or someone pretending to be a renegade academic. It's not like there is a KYC process.

Re: Facebook LLAMA is being openly distributed via torrents

#75
post #41

It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. This has not been the case for most commercial software for the past 20 years, during the cloud era. If you could steal a dump of random Facebook source code, it would be 99% useless because it’s so closely tied to the infrastructure. There’s almost nothing yo…

If you were to steal a chunk of source code or a binary from meta/Google, you could probably get it running inside a few weeks effort. Sure, the binary probably depends on a lot of internal proprietary infrastructure, but also most of that infrastructure is easy to write a mock implementation of, as long as you are happy for it to be in-ram, not multi-homed and don't need it to scale to billions of users. Most of the…

Good luck even getting a google3-based Hello World to compile. I don't remember the exact numbers, but just #including the most basic libs resulted in a O(100M) binary.

And anything more complex than that would probably have dependencies on so many fat client libs, so much infrastructure, and so many external services, that you'll need months-years to even make sense of them, let alone mock them up.

Re: Facebook LLAMA is being openly distributed via torrents

#76
post #67

Earlier quoted context omitted.

If you were to steal a chunk of source code or a binary from meta/Google, you could probably get it running inside a few weeks effort. Sure, the binary probably depends on a lot of internal proprietary infrastructure, but also most of that infrastructure is easy to write a mock implementation of, as long as you are happy for it to be in-ram, not multi-homed and don't need it to scale to billions of users. Most of the…

-1: as an ex-googler, I can say it was hard enough for Google itself to get its code to run, given gonzo infrastructure assumptions, proprietary libraries/languages, etc.

That speaks volumes of the code quality @ Google.

Re: Facebook LLAMA is being openly distributed via torrents

#77
post #49
post #45

Earlier quoted context omitted.

> massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. So, like movies or software

Or Microsoft Office...

Or Linux distro's.

Re: Facebook LLAMA is being openly distributed via torrents

#78
post #56

Earlier quoted context omitted.

If it's PyTorch, it can definitely contain and execute arbitrary code. One of the reasons I'm not a huge fan of PyTorch.

They could contain arbitrary code... But typically do not. That means that with the right viewer application it will be trivial to know for sure. It isn't like a multi gigabyte game for example, where knowing if there is any malicious code could easily be a multi-month reverse engineering project to get to the answer of 'probably not, but we don't have time to check every byte with a fine tooth comb'

I only found this picklescan[0] serving this purpose, but it doesn't seem to be a finished project.

[0] - https://github.com/mmaitre314/picklescan

Re: Facebook LLAMA is being openly distributed via torrents

#80
post #73
post #41

It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. This has not been the case for most commercial software for the past 20 years, during the cloud era. If you could steal a dump of random Facebook source code, it would be 99% useless because it’s so closely tied to the infrastructure. There’s almost nothing yo…

> It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. I was trying to come to grasp with how much resource there is concentrated in one of these models. Somehow I come to the conclusion that it cost more than buying a jet airliner to train one of these models. And it is about the same order of money as commissi…

GPT-3 cost a few million dollars in compute to train from what I know.
Post reply on HN