Also those with very heavy investment in AI are looking for bonkers results, which is the cause of their disappointment. They need to reduce their expectations. I for one am loving the results so far.
Zuckerberg says AI agent development going slower than expected
121–130 of 661 posts
Re: Zuckerberg says AI agent development going slower than expected
#122I was worried this time last year that by this time this year, companies would have slashed their engineering teams down to a handful and everything would be driven by mostly autonomous agents with human guidance. But it just hasn't happened. Do I write all my code with an agent now? Yes. Can you just give an agent a desired outcome and let it work, unsupervised? Absolutely not. I can produce more code than I used to…
Re: Zuckerberg says AI agent development going slower than expected
#123Re: Zuckerberg says AI agent development going slower than expected
#124Earlier quoted context omitted.
I agree, i don't think it is the core problem. Meta doesn't seem to be able to produce anything close to a frontier model. The selling of compute capacity seems to be acceptance of "compute is wasted on this crappy avocado model, we'd be better off allowing something better to run". The problem is clearly in the model architecture, the training and the data fed into the model which is causing them to give up on using…
Meta has made some very strange decisions in terms of who it's hired to lead various aspects of AI, including the model-building efforts. Also lots to marvel at re: its ability to coordinate (or not coordinate) various efforts by all these big brains. Can't help but think that Meta's digital networking expertise is built atop a human-networking clusterf*ck
I think there would easily be a few other hundred engineers and execs at frontier labs who are more in the loop for cutting edge architecture/secret sauce - with a track record of actually doing it - that could be had for a fraction of the price.
Re: Zuckerberg says AI agent development going slower than expected
#125I wonder when he'll admit his hopes were baseless
Re: Zuckerberg says AI agent development going slower than expected
#126I think what everyone underestimated was the absolute bonkers amount of compute it will take and how that compute must scale in order to keep up with larger and larger models.
Re: Zuckerberg says AI agent development going slower than expected
#127Earlier quoted context omitted.
I think Meta’s massive compute investment was never about its 100,000 engineers running coding models, but its 3,500,000,000 users wanting to use AI in every single product (and some new ones: Meta AI, glasses, etc.) So I would think that’s the part that’s not being utilized anywhere near the amount they hoped...
Do the 3.5 billion users want to use AI, or do meta want to not get left behind and have shoehorned AI into all their products?
Re: Zuckerberg says AI agent development going slower than expected
#128I think what everyone underestimated was the absolute bonkers amount of compute it will take and how that compute must scale in order to keep up with larger and larger models.
Re: Zuckerberg says AI agent development going slower than expected
#129My instinct (for better or worse) is usually contrarian. Most people seem very skeptical of what Meta is doing with AI. But, what if, in a way at least, it makes sense? Maybe Wang has correctly identified that the programming and agentic ability that Anthropic and OpenAI models have has largely come from armies of software engineers creating massive datasets by writing out coding and agentic problems and solutions? S…
In that market you can build a model and spend a lot of money on it and at best get something that's on the same frontier as everybody else but just as likely end up with uncompetitive models like the ones they have now.
You might save a bit running your own models, doing your own inference, etc. Why not take advantage of "last mover advantage" and buy whatever is best when you need it and figure the odds are good that everybody else is going to buy more GPUs than they need and as a large customer you'll be able to buy in bulk at fire sale prices?
Re: Zuckerberg says AI agent development going slower than expected
#130My instinct (for better or worse) is usually contrarian. Most people seem very skeptical of what Meta is doing with AI. But, what if, in a way at least, it makes sense? Maybe Wang has correctly identified that the programming and agentic ability that Anthropic and OpenAI models have has largely come from armies of software engineers creating massive datasets by writing out coding and agentic problems and solutions? S…
While I mostly agree with your post, I do want to point out one thing: > Or he could release a model trained largely by existing open weights models. Which without some huge breakthrough probably has no chance of surpassing them, so is pointless. This seems to be categorically untrue. Composer 2.5 is a substantial improvement on its underlying Kimi base model.
They may eventually have to do that. Or they might be starting with an existing Llama model. Maybe I should have said "huge breakthrough or additional dataset".