Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Superintelligence Labs' first paper is about RAG

paddedinputs.substack.com

Post reply on HN
Print view View original

31–40 of 283 posts

Re: Meta Superintelligence Labs' first paper is about RAG

#31

Post by crorella »

terminalshort wrote: post #16
xvector wrote: post #13

Working in big tech it's pretty wild to see how integral AI has become to our work internally, vs the public perception of it. People are NOT prepared.

1. Hyperbolic statement about LLM capabilities with no concrete examples 2. Wild claim that the companies that sell LLMs are actually downplaying their capabilities instead of hyping them

Personal experience here in a FAANG, there has been a considerable increase in: 1. Teams exploring how to leverage LLMs for coding. 2. Teams/orgs that already standardized some of the processes to work with LLMs (MCP servers, standardized the creation of the agents.md files, etc) 3. Teams actively using it for coding new features, documenting code, increasing test coverage, using it for code reviews etc.

Again, personal, experience, but in my team ~40-50% of the PRs are generated by Codex.

Re: Meta Superintelligence Labs' first paper is about RAG

#32

Post by inquirerGeneral »

signatoremo wrote: post #25
pppoe wrote: post #21

I find it absurd that, compared to the past, large companies now have more abundant stock prices and cash than ever before, yet nearly every AI Lab in these companies is facing greater pressure than ever, being asked to generate short-term profits. In the midst of AI's unprecedented boom, the research environment and atmosphere in the industry seem to have worsened compared to the past.

Is this Meta’s lab pressured to generate short term profits? Which other under pressure labs are you talking about?

[dead]

Re: Meta Superintelligence Labs' first paper is about RAG

#33

Post by incompatible »

xvector wrote: post #13

Working in big tech it's pretty wild to see how integral AI has become to our work internally, vs the public perception of it. People are NOT prepared.

I've heard of one study that said AI slows developers down, even when they think it's helping.

https://www.infoworld.com/article/4061078/the-productivity-p...

Re: Meta Superintelligence Labs' first paper is about RAG

#37

Post by DangitBobby »

rhetocj23 wrote: post #30
yalogin wrote: post #26

I am not surprised because the culture at meta is not at all, even in the slightest, to focus on science for the sake of it. It’s actively actively purged out of you. The focus is on metrics and how the bottom line is impacted. So this is in line with that

Yeah and this problem is near impossible to fix once it has infested into the culture of the firm.

It's not always a bad thing though, like in this case they looked for a practical win and found one because impractical wins can't make them money.

Re: Meta Superintelligence Labs' first paper is about RAG

#38

Post by didip »

godelski wrote: post #15

It's kinda funny, Meta has long had some of the best in the field, but left them untapped. I really think if they just took a step back and stop being so metric focused and let their people freely explore then they'd be winning the AI race. But with this new team, I feel like meta mostly hired the people who are really good at gaming the system. The people that care more about the money than the research. A bit of th…

I always wonder about that. Those $100m Mathematicians... how can they have rooms to think under Meta's crushing IMPACT pressure?

Re: Meta Superintelligence Labs' first paper is about RAG

#39

Post by thereitgoes456 »

bobxmax wrote: post #28
godelski wrote: post #15

It's kinda funny, Meta has long had some of the best in the field, but left them untapped. I really think if they just took a step back and stop being so metric focused and let their people freely explore then they'd be winning the AI race. But with this new team, I feel like meta mostly hired the people who are really good at gaming the system. The people that care more about the money than the research. A bit of th…

I thought Alex Wang was a very curious choice. There are so many foundational AI labs with interesting CEOs... I get that Wang is remarkable in his own right, but he basically just built MTurk and timed the bubble. Doesn't really scream CEO of AGI to me.

The reportings at the time said that he was Mark’s 5th choice or similar. It is fairly clear he would prefer Ilya, Murati, Mark Chen, and perhaps others, but they said no, and Alex Wang was the first one to say yes.

Re: Meta Superintelligence Labs' first paper is about RAG

#40

Post by godelski »

bobxmax wrote: post #28
godelski wrote: post #15

It's kinda funny, Meta has long had some of the best in the field, but left them untapped. I really think if they just took a step back and stop being so metric focused and let their people freely explore then they'd be winning the AI race. But with this new team, I feel like meta mostly hired the people who are really good at gaming the system. The people that care more about the money than the research. A bit of th…

I thought Alex Wang was a very curious choice. There are so many foundational AI labs with interesting CEOs... I get that Wang is remarkable in his own right, but he basically just built MTurk and timed the bubble. Doesn't really scream CEO of AGI to me.

A lot of people also don't know that many of the well known papers are just variations on small time papers with a fuck ton more compute thrown at the problem. Probably the strongest feature that correlates to successful researcher is compute. Many have taken this to claim that the GPU poor can't contribute but that ignores so many other valid explanations... and we wonder why innovation has slowed... It's also weird because if compute was all you need then there's a much cheaper option than Zuck paid. But he's paying for fame.
Post reply on HN