Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Superintelligence Labs' first paper is about RAG

paddedinputs.substack.com

Post reply on HN
Print view View original

51–60 of 283 posts

Re: Meta Superintelligence Labs' first paper is about RAG

#51

Post by trhway »

didip wrote: post #38
godelski wrote: post #15

It's kinda funny, Meta has long had some of the best in the field, but left them untapped. I really think if they just took a step back and stop being so metric focused and let their people freely explore then they'd be winning the AI race. But with this new team, I feel like meta mostly hired the people who are really good at gaming the system. The people that care more about the money than the research. A bit of th…

I always wonder about that. Those $100m Mathematicians... how can they have rooms to think under Meta's crushing IMPACT pressure?

For just 10% of those money a $100M mathematician can hire 10 $1M mathematicians or a whole math dept in some European university to do the work and the thinking for them and thus beat any pressure while resting and vesting on the remaining 90%.

Re: Meta Superintelligence Labs' first paper is about RAG

#52

Post by rhetocj23 »

godelski wrote: post #15

It's kinda funny, Meta has long had some of the best in the field, but left them untapped. I really think if they just took a step back and stop being so metric focused and let their people freely explore then they'd be winning the AI race. But with this new team, I feel like meta mostly hired the people who are really good at gaming the system. The people that care more about the money than the research. A bit of th…

"Maybe if you want to get ahead you gotta stop thinking like everyone else"

Well for starters you need a leader who can rally the troops who "think(s) different" - something like a S Jobs.

That person doesnt seem to exist in the industry right now.

Re: Meta Superintelligence Labs' first paper is about RAG

#53

Post by rhetocj23 »

crorella wrote: post #31
terminalshort wrote: post #16

Earlier quoted context omitted.

1. Hyperbolic statement about LLM capabilities with no concrete examples 2. Wild claim that the companies that sell LLMs are actually downplaying their capabilities instead of hyping them

Personal experience here in a FAANG, there has been a considerable increase in: 1. Teams exploring how to leverage LLMs for coding. 2. Teams/orgs that already standardized some of the processes to work with LLMs (MCP servers, standardized the creation of the agents.md files, etc) 3. Teams actively using it for coding new features, documenting code, increasing test coverage, using it for code reviews etc. Again, perso…

Im sure the MBA folks love stats like that - theres plenty that have infested big tech. I mean Pichai is an MBA+Mckinsey Alumni.

Ready for the impending lay off fella?

Re: Meta Superintelligence Labs' first paper is about RAG

#54

Post by godelski »

rhetocj23 wrote: post #50
godelski wrote: post #40

Earlier quoted context omitted.

A lot of people also don't know that many of the well known papers are just variations on small time papers with a fuck ton more compute thrown at the problem. Probably the strongest feature that correlates to successful researcher is compute. Many have taken this to claim that the GPU poor can't contribute but that ignores so many other valid explanations... and we wonder why innovation has slowed... It's also weird…

Frankly this is the reason why Im not convinced the current movement of LLMs will yield anything close to the dream. The right people to deliver immense progress dont exist right now.

  > The right people to deliver immense progress dont exist right now.
I wouldn't go this far. But I would say that we're not giving them a good shot.

The people are always there, you just need to find them and enable them.

  How do you manage genius? You don’t.
  — Mervin Kelly

Re: Meta Superintelligence Labs' first paper is about RAG

#55

Post by georgeburdell »

yalogin wrote: post #26

I am not surprised because the culture at meta is not at all, even in the slightest, to focus on science for the sake of it. It’s actively actively purged out of you. The focus is on metrics and how the bottom line is impacted. So this is in line with that

It’s not that simple. I worked at a supplier of Meta and they paid us large NREs to fund our exploratory work

Re: Meta Superintelligence Labs' first paper is about RAG

#56

Post by lblume »

trhway wrote: post #51
didip wrote: post #38

Earlier quoted context omitted.

I always wonder about that. Those $100m Mathematicians... how can they have rooms to think under Meta's crushing IMPACT pressure?

For just 10% of those money a $100M mathematician can hire 10 $1M mathematicians or a whole math dept in some European university to do the work and the thinking for them and thus beat any pressure while resting and vesting on the remaining 90%.

Sure, but they weren't hired as managers, right?

Re: Meta Superintelligence Labs' first paper is about RAG

#57

Post by lblume »

Imnimo wrote: post #10

I'm curious whether this is work that was specifically begun under the "superintelligence" umbrella, or if it's just that the people who were working on it had been shifted to the Superintelligence team by the time they wrote the paper. I would guess the former?

Another commenter claims the latter: https://news.ycombinator.com/item?id=45554169

Re: Meta Superintelligence Labs' first paper is about RAG

#58

Post by antonvs »

puttycat wrote: post #41

Seems very incremental and very far from the pompous 'superintelligence' goal.

It’s unlikely that the existing LLM architecture will evolve into anything that resembles superintelligence any more than it does already.

Which means that modifications to the architecture, and combining it with other components and approaches, are the next likely step. This paper fits that.

Re: Meta Superintelligence Labs' first paper is about RAG

#59

Post by ProofHouse »

godelski wrote: post #15

It's kinda funny, Meta has long had some of the best in the field, but left them untapped. I really think if they just took a step back and stop being so metric focused and let their people freely explore then they'd be winning the AI race. But with this new team, I feel like meta mostly hired the people who are really good at gaming the system. The people that care more about the money than the research. A bit of th…

winning the AI race? Meta? Oh that was a good one. Zuck is a follower not a leader. It is in his DNA

Re: Meta Superintelligence Labs' first paper is about RAG

#60

Post by sefrost »

pppoe wrote: post #21

I find it absurd that, compared to the past, large companies now have more abundant stock prices and cash than ever before, yet nearly every AI Lab in these companies is facing greater pressure than ever, being asked to generate short-term profits. In the midst of AI's unprecedented boom, the research environment and atmosphere in the industry seem to have worsened compared to the past.

Is it because of the "winner takes all" and "lock-in effects" of being the first to market?
Post reply on HN