151–159 of 159 posts
If we take coding off the table i don't see the case for large agent swarms. More is not always better in my experience experimenting with agents
If you can't see cases for it you may need some glasses. Replace the graph in the docs of Top-level planner -> mid-level planners -> worker leaf nodes and you get an org chart of CEO -> executives, N-levels of management, and ICs at the leafs. It directly maps to almost any office-based company that can operate completely digitally. It's obviously in its infancy but fully agentic companies are becoming a possibility,…
I initially thought that getting agents to work for longer and in large groups was the future, but I'm increasingly thinking that, at least for engineering, just one thread makes more sense. The agent pulls things into context as needed. One thing that I've been experimenting with is also letting the agent remove things from context, such as files. But just adding to the context and compacting when it's full seems li…
Have you used this method yourself for long workflows and with contexts approaching 1 million tokens? It doesn't work very well. LLM context is nearly half unusable.
Earlier quoted context omitted.
Genuinely Fable would do a decent job.
Yep and they still don't do it! So we should do as they do, not as they say
Earlier quoted context omitted.
How much slop you figure Shakespeare produced?
Honestly judging from the volume of his output, a ton . It’s rare to run into prodigious artists who simply produce a few perfect pieces - as a rule those few magnum opuses are built on a hill of cutting room floor scraps.
I assure the worst of Shakespeares work is far beyond anything most writers can produce, much less the incoherent slop LLMs generate
Earlier quoted context omitted.
Have you used this method yourself for long workflows and with contexts approaching 1 million tokens? It doesn't work very well. LLM context is nearly half unusable.
I've found that model performance starts substantially degrading after 10%.
Earlier quoted context omitted.
Yep and they still don't do it! So we should do as they do, not as they say
I do somewhat agree. I can only speculate that they're pumping out new features incredibly fast and they don't want to fall a month behind the competition.
Unless they're lying that is!
Earlier quoted context omitted.
Honestly judging from the volume of his output, a ton . It’s rare to run into prodigious artists who simply produce a few perfect pieces - as a rule those few magnum opuses are built on a hill of cutting room floor scraps.
The director James Cameron stands out because he has only produced huge box office hits. Extremely hard to do like you said, and most artists and auteurs would be happy to have one great work they can be remembered for, even if it's amidst a dozen forgettable pieces.