Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Llama 3

llama.meta.com

Post reply on HN
Print view View original

441–450 of 965 posts

Re: Meta Llama 3

#441

Post by jdminhbg »

a_wild_dandan wrote: post #425
paxys wrote: post #240

Earlier quoted context omitted.

You can see from Zuck's interviews that he is still an engineer at heart. Every other big tech company has lost that kind of leadership.

Also, being open source adds phenomenal value for Meta: 1. It attracts the world's best academic talent, who deeply want their work shared. AI experts can join any company, so ones which commit to open AI have a huge advantage. 2. Having armies of SWEs contributing millions of free labor hours to test/fix/improve/expand your stuff is incredible. 3. The industry standardizes around their tech, driving down costs and d…

Commoditize Your Complements: https://gwern.net/complement

Re: Meta Llama 3

#442

Post by dumbfounder »

FrustratedMonky wrote: post #359
noiseinvacuum wrote: post #328

Earlier quoted context omitted.

He went into the details of how he thinks about open sourcing weights for Llama responding to a question from an analyst in one of the earnings call last year after Llama release. I had made a post on Reddit with some details. https://www.reddit.com/r/MachineLearning/s/GK57eB2qiz Some noteworthy quotes that signal the thought process at Meta FAIR and more broadly * We’re just playing a different game on the infrastru…

"different game" But what game? What is the AI play that makes giving it away a win for meta?

Weaken the competition (google and ms). Bing doesn’t exist because it’s a big money maker for ms, it exists to put a dent in google’s power. Android vs apple. If you can’t win then you try to make the others lose.

Re: Meta Llama 3

#443

Post by realce »

sunaookami wrote: post #312
matsemann wrote: post #75

Earlier quoted context omitted.

> Meta AI isn't available yet in your country Where is it available? I got this in Norway.

>We’re rolling out Meta AI in English in more than a dozen countries outside of the US. Now, people will have access to Meta AI in Australia, Canada, Ghana, Jamaica, Malawi, New Zealand, Nigeria, Pakistan, Singapore, South Africa, Uganda, Zambia and Zimbabwe — and we’re just getting started. https://about.fb.com/news/2024/04/meta-ai-assistant-built-wi...

That's a strange list of nations, isn't it? I wonder what their logic is.

Re: Meta Llama 3

#444

Post by HeatrayEnjoyer »

gliched_robot wrote: post #113
worldsayshi wrote: post #29

Earlier quoted context omitted.

I suspect that there is some psychological effect going on where people adjust their expectations and start to be more open to noticing flaws after working with it for a while. Seems to be a recurring thing with most models.

The code it writes is getting worse eg. lazy and not updating the function, not following prompts etc. So we can objectively say its getting worse.

So you posit they are lying?

Re: Meta Llama 3

#445

Post by gliched_robot »

deelowe wrote: post #284
eigenvalue wrote: post #231

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

Meta also spearheaded the open compute project. I originally joined Google because of their commitment to open source and was extremely disappointed when I didn't see that culture continue as we worked on exascale solutions. Glad to see Meta carrying the torch here. Hope it continues.

I see what you did here carrying the "torch" . LOL

Re: Meta Llama 3

#446

Post by stuckkeys »

paxys wrote: post #240
eigenvalue wrote: post #231

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

You can see from Zuck's interviews that he is still an engineer at heart. Every other big tech company has lost that kind of leadership.

Yeah. He did good.

Re: Meta Llama 3

#447

Post by visarga »

FrustratedMonky wrote: post #354
evnc wrote: post #309

Earlier quoted context omitted.

They're commoditizing their complement [0][1], inasmuch as LLMs are a complement of social media and advertising (which I think they are). They've made it harder for competitors like Google or TikTok to compete with Meta on the basis of "we have a super secret proprietary AI that no one else has that's leagues better than anything else". If everyone has access to a high quality AI (perhaps not the world's best, but c…

Yes. And, could potentially diminish OpenAI/MS. Once everyone can do it, then OpenAI value would evaporate.

Once every human has access to cutting edge AI, that ceases to be a differentiating factor, so the human talent will again be the determining factor.

Re: Meta Llama 3

#448

Post by HWR_14 »

dntrkv wrote: post #337
tmalsburg2 wrote: post #324

Earlier quoted context omitted.

Love how everyone is romanticizing his engineering mindset. But have we already forgotten that he was even more passionate about the metaverse which, as far as I can tell, was a 50B failure?

I think that part of his bet is that AI is a key component of getting the metaverse to take off. E.g. generating content for the metaverse via AI

It's hard for me to imagine AI really helping Meta. It might make content cheaper, but Meta was not budget limited.

Re: Meta Llama 3

#449

Post by visarga »

ben_w wrote: post #403
FrustratedMonky wrote: post #354

Earlier quoted context omitted.

Yes. And, could potentially diminish OpenAI/MS. Once everyone can do it, then OpenAI value would evaporate.

> Once everyone can do it, then OpenAI value would evaporate. If you take OpenAI's charter statement seriously, the tech will make most humans' (economic) value evaporate for the same reason. https://openai.com/charter

> will make most humans' (economic) value evaporate for the same reason

With one hand it takes, with the other it gives - AI will be in everyone's pocket, and super-human level capable of serving our needs; the thing is, you can't copy a billion dollars, but you can copy a LLaMA.

Re: Meta Llama 3

#450

Post by internet101010 »

modeless wrote: post #237
bbig wrote: post #16

Zuck has an interview out for it as well, https://twitter.com/dwarkesh_sp/status/1780990840179187715

Seems like a year or two of MMA has done way more for his charisma than whatever media training he's done over the years. He's a lot more natural in interviews now.

People may not like Joe Rogan but he described BJJ perfectly: 3D chess with consequences. It is a great way to relieve stress and forces you to temporarily forget about whatever is bothering you that day.
Post reply on HN