But if you look at projects like Autogen ( https://github.com/microsoft/autogen ), you see one master agent coordinating other agents which have a narrower scope. But you have to create the prompts for the agents yourself.
This GPTs setup will crowd-source a ton of data on creating agents which serve a single task. Then they can train a model that's very good at creating other agents. Altman nods to this immediately after the GPTs feature is shown, repeating that OpenAI does not train on API usage.
Prediction: next year's dev day, which Altman hints will make today's conference look "quaint" by comparison, will basically be an app built around the autogen concept, but which you can spin up using very simple prompts to complete very complex tasks. Probably on top of a mixture of GPT 4 & 5.