So like rubber ducking for AI?
Chain of Recursive Thoughts: Make AI think harder by making it argue with itself
51–60 of 253 posts
Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself
#52Why try this idea on base models only?
The whole point of reasoning models is to automatically use COT and related techniques to bring out more capabilities.
It would be interesting to see if this is doing anything that’s not already being exploited.
Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself
#53Earlier quoted context omitted.
Well, the service is doing the same thing though. The part I don't understand is that I assume n8n is short for "Nation" but literally every single person I've seen talk about it on YouTube (which is quite a lot) say "En Eight En" every time.
nation is too short for 8 - maybe navigation?
Looks like n8n is short for nodemation
Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself
#54I kind of want to try something like this at a larger scale in an always-on mode where I have a 'senate' of debate. Rather than responding to prompts on a case by case basis, provide a list of tasks (potentially with deadlines) and let the senate work on them, break off into groups to manage subtasks, challenge results , make suggestions. Even potentially a tree of analysts where suggestions only gets passed up the tree when the parent node thinks a lower analysis is particularly insightful.
I definitely think that directing models to approach a problem from a specific perspective can generate better or worse results. Creating a diverse set of perspectives along with critical analysis of their results should be able to produce some impressive results.
Things like this would generate a massive number of tokens, but the cost per token is definitely heading in the right direction to allow for this. There is also the possibility of setting up an AI only IRC server where anybody can connect their own models for a shared debating chamber.
Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself
#55Yes, give the computers anxiety too!
Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself
#56I, too, like to give Terminator lite anxiety.
Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself
#57Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself
#58I'm having a lot of fun experimenting with stuff like this. I'm trying to put together an unrealengine blueprints style graph editor to allow people to design workflows like this where you start with the user prompt input, which goes to one agent, which makes an initial attempt, and then that conversation history gets passed to another "agent" with a different system prompt telling it to be a harsh critic, but to als…
I think you can do most of this already with llm-consortium (maybe needs the llm-openrouter plugin with my pr merging)
A consortium sends the same prompt to multiple models in parallel and the responses are all sent to one arbiter model which judges the model responses. The arbiter decides if more iterations are required. It can also be forced to iterate more until confidence-threshold or min-iterations.
Now, using the pr i made to llm-openrouter, you can save an alias to a model that includes lots of model options. For examples, you can do llm openrouter save -m qwen3 -o online -o temperature 0, system "research prompt" --name qwen-researcher
And now, you can build a consortium where one member is an online research specialist. You could make another uses JSON mode for entity extraction, and a third which writes a blind draft. The arbiter would then make use of all that and synthesize a good answer.
Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself
#59Earlier quoted context omitted.
I am thinking the same thing! Multiple "personalities", in parallel, or in series. For example, I have approximated, in GPT, some of Gemini's ability to call out nonsense, sloppy thinking, by telling GPT to be mean! (The politeness seems to filter out much that is of great value!) However, the result is not pleasant to read. Gemini solved this in their training, by doing it in two phases... and making the first phase…
I disagree. If anything, telling GPT to be blunt seems to downgrade its IQ; it hallucinates more and makes statements without considering priors or context. I jokingly call it Reddit mode.
why would that be a joke? there's a ton of Reddit comments in the training data, and the output is of similar quality. LLMs are literally outputting average Reddit comments.
Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself
#60Debates have worked good for me while learning something new:
https://lepisma.xyz/2024/10/19/interventional-debates-for-st...
I believe there are researches on this too.