Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Llama 3

llama.meta.com

Post reply on HN
Print view View original

351–360 of 965 posts

Re: Meta Llama 3

#351

Post by freedomben »

tmalsburg2 wrote: post #324
noiseinvacuum wrote: post #254

Earlier quoted context omitted.

Good thing that he's only 39 years old and seems more energetic than ever to run his company. Having a passionate founder is, imo, a big advantage for Meta compared to other big tech companies.

Love how everyone is romanticizing his engineering mindset. But have we already forgotten that he was even more passionate about the metaverse which, as far as I can tell, was a 50B failure?

It's a bit too early IMHO to declare the metaverse a failure.

But that said, I don't think it matters. I don't know anybody who hasn't been wrong about something, or made a bad bet at times. Even if he is wrong about everything else (which he's not, because plenty of important open source has come out of facebook), that doesn't change the extreme importance that is Llama and Meta's willingness to open things up. It's a wonderful gift they have given to humanity that has only barely started.

Re: Meta Llama 3

#352

Post by tmalsburg2 »

filoleg wrote: post #336
tmalsburg2 wrote: post #324

Earlier quoted context omitted.

Love how everyone is romanticizing his engineering mindset. But have we already forgotten that he was even more passionate about the metaverse which, as far as I can tell, was a 50B failure?

Having an engineering mindset is not the same as never making mistakes (or never being too early to the market). The only way you won’t make those mistakes and keep a perfect record is if you never do anything major or step out of the comfort zone. If Apple didn’t try and fail with Newton[0] (which was too early to the market for many reasons, both tech-related and not), we might’ve not had iPhone today. The engineer…

His engineering mindset made him blind to the fact the metaverse was a product that nobody wanted or needed. In one of the Fridman interviews, he goes on and on about all the cool technical challenges involved in making the metaverse work. But when Fridman asked him what he likes to do in his spare time, it was all things that you could precisely not do in the metaverse. It was baffling to me that he failed to connect the dots.

Re: Meta Llama 3

#353

Post by szundi »

elevatedastalt wrote: post #331
eigenvalue wrote: post #231

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

That's coz he is a founder CEO. Those guys are built different. It's rare for the careerist MBA types to match their passion or sincerity. There are many things I can criticize Zuck for but lack of sincerity for the mission is not one of them.

It is just the reverse: he is successful because he is like that and lots of founder ceos are jellies in comparison

Re: Meta Llama 3

#354

Post by FrustratedMonky »

evnc wrote: post #309
swalsh wrote: post #279

Earlier quoted context omitted.

Why is Meta doing it though? This is an astronomical investment. What do they gain from it?

They're commoditizing their complement [0][1], inasmuch as LLMs are a complement of social media and advertising (which I think they are). They've made it harder for competitors like Google or TikTok to compete with Meta on the basis of "we have a super secret proprietary AI that no one else has that's leagues better than anything else". If everyone has access to a high quality AI (perhaps not the world's best, but c…

Yes. And, could potentially diminish OpenAI/MS.

Once everyone can do it, then OpenAI value would evaporate.

Re: Meta Llama 3

#356

Post by dntrkv »

ravetcofx wrote: post #335
tmalsburg2 wrote: post #324

Earlier quoted context omitted.

Love how everyone is romanticizing his engineering mindset. But have we already forgotten that he was even more passionate about the metaverse which, as far as I can tell, was a 50B failure?

What's wrong with someone playing with millennia equivalent of millions of human life times worth of income like a disposable toy? /s

Yeah because all that research and knowledge completely dissipates because the business hasn’t recouped its R&D costs.

Apple famously brought the iPhone into existence without any prior R&D or failed attempts to build similar devices.

Re: Meta Llama 3

#357

Post by akgerber »

HarHarVeryFunny wrote: post #281
margorczynski wrote: post #225

Looks like it (the 8B version) blows out of the water the other free models, really great stuff from Yann and Zuck. Guess the moat is disappearing day by day.

Pretty sure Yann is not involved in this - Meta has a separate GenAI group headed up by Ahmad Al-Dahle (@Ahmad_Al_Dahle).

Yann Lecun's name is listed in the model card: https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md

Re: Meta Llama 3

#358

Post by axus »

paxys wrote: post #240
eigenvalue wrote: post #231

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

You can see from Zuck's interviews that he is still an engineer at heart. Every other big tech company has lost that kind of leadership.

I'm happy that he's pouring money into the metaverse, and glad that it's not my money.

Re: Meta Llama 3

#359

Post by FrustratedMonky »

noiseinvacuum wrote: post #328
swalsh wrote: post #279

Earlier quoted context omitted.

Why is Meta doing it though? This is an astronomical investment. What do they gain from it?

He went into the details of how he thinks about open sourcing weights for Llama responding to a question from an analyst in one of the earnings call last year after Llama release. I had made a post on Reddit with some details. https://www.reddit.com/r/MachineLearning/s/GK57eB2qiz Some noteworthy quotes that signal the thought process at Meta FAIR and more broadly * We’re just playing a different game on the infrastru…

"different game"

But what game? What is the AI play that makes giving it away a win for meta?

Re: Meta Llama 3

#360

Post by YetAnotherNick »

tmalsburg2 wrote: post #324
noiseinvacuum wrote: post #254

Earlier quoted context omitted.

Good thing that he's only 39 years old and seems more energetic than ever to run his company. Having a passionate founder is, imo, a big advantage for Meta compared to other big tech companies.

Love how everyone is romanticizing his engineering mindset. But have we already forgotten that he was even more passionate about the metaverse which, as far as I can tell, was a 50B failure?

That's the point. He does things because he is excited about something, not to please shareholders. Shareholders didn't liked Metaverse at all. And shareholders likely don't like spending billion dollar in GPUs just to give the benefit away for free to others.
Post reply on HN