Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Llama 3

llama.meta.com

Post reply on HN
Print view View original

431–440 of 965 posts

Re: Meta Llama 3

#431

Post by mirsadm »

minimaxir wrote: post #72
refulgentis wrote: post #30

Earlier quoted context omitted.

Over yonder: https://x.com/alexalbert__/status/1780707227130863674 my $0.02: it makes me very uncomfortable that people misunderstand LLMs enough to even think this is possible

It is 100% possible for performance regressions to occur by changing the model pipeline and not the model itself. A system prompt is a part of said pipeline. Prompt engineering is surprisingly fragile.

Is that surprising? Seemed like a giant hack to me. Prompt engineering sure sounds better than hack though.

Re: Meta Llama 3

#432

Post by [deleted] »

999900000999 wrote: post #393
tmalsburg2 wrote: post #324

Earlier quoted context omitted.

Love how everyone is romanticizing his engineering mindset. But have we already forgotten that he was even more passionate about the metaverse which, as far as I can tell, was a 50B failure?

The Quest is the top selling VR headset by a very large margin. He's well positioned to take that market when it eventually matures a bit. Once the tech gets there, say in a decade we might see most people primarily consume content via VR and phones. That's movies, games, TV, sporting events, concerts.

[deleted]

Re: Meta Llama 3

#433

Post by pankajdoharey »

eigenvalue wrote: post #231

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

Always bet on Zuck!

Re: Meta Llama 3

#435

Post by zone411 »

Very strong results for their size on my NYT Connections benchmark. Llama 3 Instruct 70B better than new commercial models Gemini Pro 1.5 and Mistral Large and not far away from Clause 3 Opus and GPT-4. Llama 3 Instruct 8B better than larger open weights models like Mixtral-8x22B. Full list: https://twitter.com/LechMazur/status/1781049810428088465/pho...

Re: Meta Llama 3

#437

Post by orra »

swatcoder wrote: post #271
jwoq9118 wrote: post #244

Earlier quoted context omitted.

The world at large seems to hate Zuck but it’s good to hear from people familiar with software engineering and who understand just how significant his contributions to open source and raising salaries have been through Facebook and now Meta.

> his contributions to ... raising salaries It's fun to be able to retire early or whatever, but driving software engineer salaries out of reach of otherwise profitable, sustainable businesses is not a good thing. That just concentrates the industry in fewer hands and makes it more dependent on fickle cash sources (investors, market expansion) often disconnected from the actual software being produced by their teams.…

> Nor is it great for the yet-to-mature craft that high salaries invited a very large pool of primarly-compensation-motivated people who end up diluting the ability for primarily-craft-motivated people to find and coordinate with each other in pursuit of higher quality work and more robust practices.

It's great to enjoy programming, and to enjoy your job. But we live under capitalism. We can't fault people for just working a job.

Pushing for lower salaries won't help anybody.

Re: Meta Llama 3

#438

Post by eigenvalue »

a_wild_dandan wrote: post #425
paxys wrote: post #240

Earlier quoted context omitted.

You can see from Zuck's interviews that he is still an engineer at heart. Every other big tech company has lost that kind of leadership.

Also, being open source adds phenomenal value for Meta: 1. It attracts the world's best academic talent, who deeply want their work shared. AI experts can join any company, so ones which commit to open AI have a huge advantage. 2. Having armies of SWEs contributing millions of free labor hours to test/fix/improve/expand your stuff is incredible. 3. The industry standardizes around their tech, driving down costs and d…

Yes, I completely agree with every point you made. It’s going to be so satisfying when all the AI safety people realize that their attempts to cram this protectionist/alarmist control down our throats are all for nothing, because there is an even stronger model that is totally open weights, and you can never put the genie back in the bottle!

Re: Meta Llama 3

#440

Post by maxlamb »

swatcoder wrote: post #391
eru wrote: post #316

Earlier quoted context omitted.

> It's fun to be able to retire early or whatever, but driving software engineer salaries out of reach of otherwise profitable, sustainable businesses is not a good thing. That argument could apply to anyone who pays anyone well. Driving up market pay for workers via competition for their labour is exactly how we get progress for workers. (And by 'treat well', I mean the whole package. Fortunately, or unfortunately,…

Bubbles are bubbles. They can be enjoyed/exploited (early retirment, savvy caching of excess income, etc) by workers but they don't win anybody progress and aren't a thing to celebrate. Workers (and society) have not won progress when only a handful of companies have books that can actually support their inflated pay, and the remainder are ultimately funded by investors hoping to see those same companies slurp them u…

Meta has products that are used by billions of people every week and has been extremely profitable for over 15 years, with no sign of obvious downward trend. I don't see how it can be described as a bubble.
Post reply on HN