Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Chain of Recursive Thoughts: Make AI think harder by making it argue with itself

github.com

Post reply on HN
Print view View original

101–110 of 253 posts

Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself

#101

Post by MoonGhost »

dingnuts wrote: post #59
jbm wrote: post #49

Earlier quoted context omitted.

I disagree. If anything, telling GPT to be blunt seems to downgrade its IQ; it hallucinates more and makes statements without considering priors or context. I jokingly call it Reddit mode.

why would that be a joke? there's a ton of Reddit comments in the training data, and the output is of similar quality. LLMs are literally outputting average Reddit comments.

Reddit works hard to make comments accessible to only Google. However MS + OIA might have grabbed something before Reddit-Google contract.

Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself

#103

Post by badmonster »

Have you experimented with weighting the self-evaluations based on specific criteria (e.g., correctness, clarity, creativity), or using external validators to guide the AI’s final choice? Curious how much tuning the evaluation step impacts overall performance.

Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself

#106

Post by j45 »

There appear to be no shortage of token saving attempts that can end up using more tokens, whether it's a monthly paid plan or API.

Having an approach to recognize what is needed from the AI software, and anticipate how it may default to respond based on it's programming is critical.

Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself

#107

Post by casenmgreen »

hackinthebochs wrote: post #27
casenmgreen wrote: post #10

[flagged]

Don't people get tired of having this same "debate" on every post about LLMs? And I scare quote debate because the naysayers never support their strong claims beyond the most superficial of responses. It's all just so tiring at this point.

The most superficial response is adequate, where the claim is so improper.

LLM/AI are extremely useful. I am in no way disputing this.

Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself

#109

Post by MoonGhost »

mikepurvis wrote: post #70
Lerc wrote: post #54

I kind of want to try something like this at a larger scale in an always-on mode where I have a 'senate' of debate. Rather than responding to prompts on a case by case basis, provide a list of tasks (potentially with deadlines) and let the senate work on them, break off into groups to manage subtasks, challenge results , make suggestions. Even potentially a tree of analysts where suggestions only gets passed up the t…

In doing some DevOps-y type tasks recently (ansible, packer, docker, baking images with guestfish), I've found it very frustrating how much ChatGPT will confidently tell me to use flags on tools that don't exist, or hallicinate completely non-existent functions or behaviours. And then when I spend time trying what it suggests only to hit a wall and come back like wtf mate it breezily goes "oh yes so you're right, goo…

You can't get more info from LLMs than it actually holds. Like Anthropic pointed if LLMs knows the name but has no other info it starts hallucinating. The same probably happens here. LLM knows there must be a flag but can't remember all of them. Likely short reminder in prompt will help. (or search web for GPT) Just my $0.02.

Re: Chain of Recursive Thoughts: Make AI think harder by making it argue with itself

#110

Post by casenmgreen »

senko wrote: post #33
casenmgreen wrote: post #10

[flagged]

Agree 100%. We should also not be calling a pointing device "a mouse" because it's not a small rodent, there aren't any actual windows inside a computer, and I haven't seen anyone balancing their laptop trying to surf the web. Also smartphones are not actually smart and are only barely phones.

I'm finding laymen are thinking AI is reasoning, because the term makes it look like this is what it is.

The potential confusion of terms such as mouse/windows/surfing is not the same as calling LLM AI, and then going on to say it is "thinking" and "reasoning".

Post reply on HN