Live data from Hacker News

Meta Llama 3

llama.meta.com

371–380 of 965 posts

Re: Meta Llama 3

#371
post #318

Earlier quoted context omitted.

Meta also spearheaded the open compute project. I originally joined Google because of their commitment to open source and was extremely disappointed when I didn't see that culture continue as we worked on exascale solutions. Glad to see Meta carrying the torch here. Hope it continues.

When did you join Google?

mid-2000s just prior to the ipo.

Re: Meta Llama 3

#372

Earlier quoted context omitted.

I don't know Dwarkesh but I despise Lex Fridman. I don't know how a man that lacks the barest modicum of charisma has propelled himself to helming a high-profile, successful podcast. It's not like he tends to express interesting or original thoughts to make up for his paucity of presence. It's bizarre. Maybe I'll check out Dwarkesh, but even seeing him mentioned him in the same breath as Fridman gives me pause ...

Maybe you should consider that others may not share your views on Lex's lack of charisma or interesting thoughts.

I'll agree that "interesting thoughts" may be up to interpretation, but imma fight you on the charisma thing. I looked up "flat affect" in the dictionary and there were no words, only a full-page headshot of Lex Fridman.

Re: Meta Llama 3

#373
post #363

Earlier quoted context omitted.

Any recommendations?

3090, trivially. No reason to go 4090 as it's no more capable, and the 5090 is probably not going to have more than 24GB on it either simply because nVidia wants to maintain their margins through market segregation (and adding more VRAM to that card would obsolete their low-end enterprise AI cards that cost 6000+ dollars).

Appreciate the info!

In another thread I saw a recommendation for dual 3090s if you're not doing anything gaming related, good to have some confirmation there.

Re: Meta Llama 3

#374
post #16

Zuck has an interview out for it as well, https://twitter.com/dwarkesh_sp/status/1780990840179187715

Seems like a year or two of MMA has done way more for his charisma than whatever media training he's done over the years. He's a lot more natural in interviews now.

I've noticed the same thing! I think the personal confidence you build training hard MMA is a lot more empowering than the presonal confidence you build from making billions of dollars and being CEO of a gigantic company. For those of us without the money, it seems hard to believe, but people are people even when they're rich, and I've seen MMA change a lot of people in the same way.

Re: Meta Llama 3

#375

Earlier quoted context omitted.

I don't know Dwarkesh but I despise Lex Fridman. I don't know how a man that lacks the barest modicum of charisma has propelled himself to helming a high-profile, successful podcast. It's not like he tends to express interesting or original thoughts to make up for his paucity of presence. It's bizarre. Maybe I'll check out Dwarkesh, but even seeing him mentioned him in the same breath as Fridman gives me pause ...

The question you should ask is: why are high-profile guests willing to talk to Lex Fridman but not others? The short answer, imho, is trust. No one gets turned into an embarrassing soundbite talking to Lex. He doesn't try to ask gotcha questions for clickbait articles. Generally speaking "the press" are not your friend and they will twist your words. You have to walk on egg shells. Lex doesn't need to express origina…

My earlier comparison was basically saying now that high-profile guests are talking to a much better interviewer (Dwarkesh), we no longer have to rely on Lex as the only podcast with long-form interviews of these guests.

Re: Meta Llama 3

#376
post #16

Zuck has an interview out for it as well, https://twitter.com/dwarkesh_sp/status/1780990840179187715

Seems like a year or two of MMA has done way more for his charisma than whatever media training he's done over the years. He's a lot more natural in interviews now.

MMA has a way to humble anyone. It's a great way to train for body and mind.

Re: Meta Llama 3

#377
post #353

Earlier quoted context omitted.

It is just the reverse: he is successful because he is like that and lots of founder ceos are jellies in comparison

I dunno. I find a conviction in passion in founder CEOs that is missing in folks who replace them. Compare Larry & Sergey with Pichai, or Gates with Balmer.

how can anyone doubt Ballmer's passion after his sweaty stage march. He ain't in charge anymore anyway. Gates was more methodical evil than passionate and his big moves were all just stabbing someone else to take their place.

Re: Meta Llama 3

#378
post #349
post #282

Earlier quoted context omitted.

With 400 billion parameters and 8 bits per parameter, wouldn't it be ~400 GB? Plus context size which could be quite large.

he said "Q4" - meaning 4-bit weights.

Ok but at 16-bit it would be 800GB+, right? Not 512.

Re: Meta Llama 3

#379

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

> I just want to express how grateful I am that Zuck

Praise for him at HN? It should be enough of a reason for him to pop a champagne today

Re: Meta Llama 3

#380
post #279

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

Why is Meta doing it though? This is an astronomical investment. What do they gain from it?

They heavily use AI internally for their core FaceBook business - analyzing and policing user content, and this is also great PR to rehabilitate their damaged image.

There is also an arms race now of AI vs AI in terms of generating and detecting AI content (incl deepfakes, election interference, etc, etc). In order not to deter advertizers and users, FaceBook need to keep up.

Post reply on HN