Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Llama 3

llama.meta.com

Post reply on HN
Print view View original

391–400 of 965 posts

Re: Meta Llama 3

#391

Post by swatcoder »

eru wrote: post #316
swatcoder wrote: post #271

Earlier quoted context omitted.

> his contributions to ... raising salaries It's fun to be able to retire early or whatever, but driving software engineer salaries out of reach of otherwise profitable, sustainable businesses is not a good thing. That just concentrates the industry in fewer hands and makes it more dependent on fickle cash sources (investors, market expansion) often disconnected from the actual software being produced by their teams.…

> It's fun to be able to retire early or whatever, but driving software engineer salaries out of reach of otherwise profitable, sustainable businesses is not a good thing. That argument could apply to anyone who pays anyone well. Driving up market pay for workers via competition for their labour is exactly how we get progress for workers. (And by 'treat well', I mean the whole package. Fortunately, or unfortunately,…

Bubbles are bubbles.

They can be enjoyed/exploited (early retirment, savvy caching of excess income, etc) by workers but they don't win anybody progress and aren't a thing to celebrate.

Workers (and society) have not won progress when only a handful of companies have books that can actually support their inflated pay, and the remainder are ultimately funded by investors hoping to see those same companies slurp them up before the bubble bursts.

Workers don't win progress when they're lured into then converting that income into impractical home loans that bind the workers with golden handcuffs and darkly shadow their future when the bubble bursts.

Workers win progress when they can practice their trade with respect and freedom and can and secure a stable, secure future for themselves and their families.

Software engineers didn't need these bubble-inflated salaries to acheive that. Like our peers in other engineering disciplines, it's practically our baseline state. What fight we do still need to make is on securing non-monetary worker's rights and professional deference, which is a different thing and gets developed in a different and more stable market environment.

Re: Meta Llama 3

#392

Post by meiraleal »

freedomben wrote: post #374
modeless wrote: post #237

Earlier quoted context omitted.

Seems like a year or two of MMA has done way more for his charisma than whatever media training he's done over the years. He's a lot more natural in interviews now.

I've noticed the same thing! I think the personal confidence you build training hard MMA is a lot more empowering than the presonal confidence you build from making billions of dollars and being CEO of a gigantic company. For those of us without the money, it seems hard to believe, but people are people even when they're rich, and I've seen MMA change a lot of people in the same way.

Zuckerberg looks like a little kid around Alex Poatan https://www.youtube.com/watch?v=Alr9HkSSyAc

Re: Meta Llama 3

#393

Post by 999900000999 »

tmalsburg2 wrote: post #324
noiseinvacuum wrote: post #254

Earlier quoted context omitted.

Good thing that he's only 39 years old and seems more energetic than ever to run his company. Having a passionate founder is, imo, a big advantage for Meta compared to other big tech companies.

Love how everyone is romanticizing his engineering mindset. But have we already forgotten that he was even more passionate about the metaverse which, as far as I can tell, was a 50B failure?

The Quest is the top selling VR headset by a very large margin.

He's well positioned to take that market when it eventually matures a bit. Once the tech gets there, say in a decade we might see most people primarily consume content via VR and phones. That's movies, games, TV, sporting events, concerts.

Re: Meta Llama 3

#394

Post by [deleted] »

paxys wrote: post #240
eigenvalue wrote: post #231

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

You can see from Zuck's interviews that he is still an engineer at heart. Every other big tech company has lost that kind of leadership.

[deleted]

Re: Meta Llama 3

#396

Post by lordswork »

PeterStuer wrote: post #234

Open weight models do more for AI safety than any other measure by far, as the most serious threath is never going to be misuse, but abuse of unequal access.

Agreed. Still not open data though, is it? i.e., we don't have access to the same data they used to train, which is useful for both finetuning and studying the model.

Re: Meta Llama 3

#397

Post by mywacaday »

eigenvalue wrote: post #231

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

Looks like it can't be accessed outside the states? I get a "Meta AI isn't available yet in your country"

Re: Meta Llama 3

#398

Post by neverokay »

swalsh wrote: post #279
eigenvalue wrote: post #231

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

Why is Meta doing it though? This is an astronomical investment. What do they gain from it?

The same thing he did with VR. Probably got tipped off Apple is on top of Vision Pro, and so just ruthlessly started competing in that market ahead of time

/tinfoil

Releasing Llama puts a bottleneck on developers becoming reliant on OpenAI/google/microsoft.

Strategically, it’s … meta.

Re: Meta Llama 3

#399

Post by dheera »

JustBreath wrote: post #373
qball wrote: post #363

Earlier quoted context omitted.

3090, trivially. No reason to go 4090 as it's no more capable, and the 5090 is probably not going to have more than 24GB on it either simply because nVidia wants to maintain their margins through market segregation (and adding more VRAM to that card would obsolete their low-end enterprise AI cards that cost 6000+ dollars).

Appreciate the info! In another thread I saw a recommendation for dual 3090s if you're not doing anything gaming related, good to have some confirmation there.

I'd also consider dual A6000-48GB (96GB total) if you have a budget of $8000 or dual V100-32GB (64GB) if you have a budget of $4000.

V100 is old and slower, but for AI applications, RAM is king and there are lots of enterprise V100's coming off racks and being sold on eBay for cheap.

Re: Meta Llama 3

#400

Post by mirekrusin »

FrustratedMonky wrote: post #354
evnc wrote: post #309

Earlier quoted context omitted.

They're commoditizing their complement [0][1], inasmuch as LLMs are a complement of social media and advertising (which I think they are). They've made it harder for competitors like Google or TikTok to compete with Meta on the basis of "we have a super secret proprietary AI that no one else has that's leagues better than anything else". If everyone has access to a high quality AI (perhaps not the world's best, but c…

Yes. And, could potentially diminish OpenAI/MS. Once everyone can do it, then OpenAI value would evaporate.

...like open balloon.
Post reply on HN