Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Facebook LLAMA is being openly distributed via torrents

github.com

Post reply on HN
Print view View original

191–200 of 719 posts

Re: Facebook LLAMA is being openly distributed via torrents

#191

Post by Brian_K_White »

notadev wrote: post #165
Brian_K_White wrote: post #145

Earlier quoted context omitted.

Since I know how to explain how little that means, I don't care what links they see me go to. If I have a work-related reason to look at something then I do, simple as that, and when your job is to engineer, almost any instance of satisfying curiosity is work related ultimately.

Saving this for when I eventually get pulled into HR. “Yes I was on PornHub, but was only looking at it for the UX inspiration”.

Porn sites have some of the best and some of the worst coding. Both are very useful to study.

Re: Facebook LLAMA is being openly distributed via torrents

#192

Post by visarga »

nodja wrote: post #93
krisoft wrote: post #73

Earlier quoted context omitted.

> It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. I was trying to come to grasp with how much resource there is concentrated in one of these models. Somehow I come to the conclusion that it cost more than buying a jet airliner to train one of these models. And it is about the same order of money as commissi…

For anyone curious, it took 2048 A100 GPUs to train LLaMa, each GPU costs roughly $15k, facebook probably gets some sort of discount. That's a $30Mil if you want to train at that scale. Also IIRC it took 23 days to train the biggest model. Someone else can do the power consumption cost calculations.

It was 1M training hours, using the price of $12/h for a box with 8x NVIDIA A100 you get $1.5m

Re: Facebook LLAMA is being openly distributed via torrents

#193

Post by bayindirh »

Brian_K_White wrote: post #158
bayindirh wrote: post #105

Earlier quoted context omitted.

Or BSD distros.

These are actually trivial and silly examples. The bulk of really valuable commercial code is not self contained or portable like those. Where is the torrent with a runnable copy of paypal, or amazon?

I guess you have never compiled a Linux/BSD distribution from scratch and supported it alongside its infrastructure and lead its maintenance process.

Even without that, if you want downloadable and runnable software platforms, look to public Git repositories. Some of the people who have no financial motivation will release what they do alongside installation procedures and quality of life scripts and architecture documentation.

Most of the open source platforms doesn't publish this documentation and doesn't make installation easy to keep a sizeable moat and protect the platform they have developed, hence this is why we have a division between "Free Software" and "Open Source".

In short, "The bulk of really valuable commercial code" is self contained, but not open source, or if open source it's not Free Software and made deployable for other parties. Otherwise it loses monetary value in the eyes of the people who develop that for the monies.

Otherwise we have have Elasticsearch incident, where they pivot and move to "Source Available" model to protect their castle.

Re: Facebook LLAMA is being openly distributed via torrents

#194

Post by Palomides »

gambiting wrote: post #154
koheripbal wrote: post #116

Earlier quoted context omitted.

Or a copy of Windows or Office source code.

I don't think that's right - even if you had the full source code for either of those, it's extremely unlikely you'd be able to build them on your own machine.

there's 99% complete leaked windows xp source code that people have managed to compile

Re: Facebook LLAMA is being openly distributed via torrents

#195

Post by dgacmu »

asah wrote: post #67
londons_explore wrote: post #55

Earlier quoted context omitted.

If you were to steal a chunk of source code or a binary from meta/Google, you could probably get it running inside a few weeks effort. Sure, the binary probably depends on a lot of internal proprietary infrastructure, but also most of that infrastructure is easy to write a mock implementation of, as long as you are happy for it to be in-ram, not multi-homed and don't need it to scale to billions of users. Most of the…

-1: as an ex-googler, I can say it was hard enough for Google itself to get its code to run, given gonzo infrastructure assumptions, proprietary libraries/languages, etc.

The effort to open source tensorflow was at least a person year worth of work to extract it from google3. Required reimplementing a bunch of stuff.

Re: Facebook LLAMA is being openly distributed via torrents

#196

Post by Brian_K_White »

bayindirh wrote: post #193
Brian_K_White wrote: post #158

Earlier quoted context omitted.

These are actually trivial and silly examples. The bulk of really valuable commercial code is not self contained or portable like those. Where is the torrent with a runnable copy of paypal, or amazon?

I guess you have never compiled a Linux/BSD distribution from scratch and supported it alongside its infrastructure and lead its maintenance process. Even without that, if you want downloadable and runnable software platforms, look to public Git repositories. Some of the people who have no financial motivation will release what they do alongside installation procedures and quality of life scripts and architecture doc…

"I guess you have never compiled a Linux/BSD distribution from scratch"

You guess, and so perhaps do other things as well, with poor acuity.

The incalculable value of open source software has approximately no bearing on this assertion.

Yes I love linux and bsd too I'm not defacing your religion. I'm actually quite Stallmanesque in making my own life harder by only using ooen source software as much as possible and being super fun a family gatherings talking about it.

You sure nailed that one.

Re: Facebook LLAMA is being openly distributed via torrents

#197

Post by micromacrofoot »

weberer wrote: post #153
causi wrote: post #102

Earlier quoted context omitted.

Just a warning to readers, I would not recommend clicking 4chan links while at work.

/g/ is one of the SFW boards

I can put on a paper bag and call it pants, but that doesn't make it a smart thing to wear to work

Re: Facebook LLAMA is being openly distributed via torrents

#198

Post by popcorncowboy »

Felminor wrote: post #42

Was to expected. Anyhow I do remember a post of a person stating this will never happen but it's just a web form and request for describing of what type of research you do Of course it will be leaked

Yeah, Meta must have had a plan for "when this gets leaked" because they put up only the flimsiest of foils. As per other comments the most likely is simply that they could shield themselves (and plausibly litigate with grounds) while ensuring that the model escapes into the wild to wreak its chaos against MS (OAI) and big G. This way they can see what's what from the safety of their shielded bubble and make a more informed call about changing the license to something more permissive if it looks like the strategic wins against their enemies would be worthwhile. Win win win. (Except for the leaker, that was an unfortunate own goal, they're going down).

Re: Facebook LLAMA is being openly distributed via torrents

#199

Post by Ntrails »

lofatdairy wrote: post #181
weberer wrote: post #153

Earlier quoted context omitted.

/g/ is one of the SFW boards

In theory, in practice I believe I was scrolling through it once in a freshman lecture and got jumpscared by a goatse pic.

>got jumpscared by a goatse pic

hello

Re: Facebook LLAMA is being openly distributed via torrents

#200

Post by IceHegel »

pavlov wrote: post #41

It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. This has not been the case for most commercial software for the past 20 years, during the cloud era. If you could steal a dump of random Facebook source code, it would be 99% useless because it’s so closely tied to the infrastructure. There’s almost nothing yo…

This is a great comment.
Post reply on HN