ChatGPT has trouble giving an answer before explaining its reasoning
1–10 of 85 posts
Re: ChatGPT has trouble giving an answer before explaining its reasoning
#2[deleted]
Re: ChatGPT has trouble giving an answer before explaining its reasoning
#3Could this phenomenon be avoided with the addition of another prompt asking it to take account of the discrepancy?
Re: ChatGPT has trouble giving an answer before explaining its reasoning
#4The most interesting part is that the author can "coerce" GPT into giving a completely opposite answer based on requiring the first token to be Yes or No, and the ways that sometimes it skirts around that without breaking the rule.
Re: ChatGPT has trouble giving an answer before explaining its reasoning
#5Really this is where you’re better off just jumping to GPT-3. OpenAI has obviously now muddied the waters with the Chat API, let alone making it so damn cheap. But ChatGPT has been tuned to be conversational and verbose. My experience has been that getting what you want by raw-dogging GPT-3 is much more fruitful.
Re: ChatGPT has trouble giving an answer before explaining its reasoning
#6The challenge here is that ChatGPT and other LLMs can only think out loud. They only "think" through writing, and that's always displayed to the user.
Has anyone tried giving LLMs a scratchpad where the model could e.g. run the pipeline in order, generate the poem, and then explicitly publish it to the user without showing the earlier steps?
Re: ChatGPT has trouble giving an answer before explaining its reasoning
#7[deleted]
Re: ChatGPT has trouble giving an answer before explaining its reasoning
#8The challenge here is that ChatGPT and other LLMs can only think out loud. They only "think" through writing, and that's always displayed to the user. Has anyone tried giving LLMs a scratchpad where the model could e.g. run the pipeline in order, generate the poem, and then explicitly publish it to the user without showing the earlier steps?
They have! The ReAct[1] model, which is available in LangChain[2]. It can be quite powerful, especially when given access to search tools.
The user just sees the "Final Answer" / Finish response from the chain's execution, even if several invocations across different tools & model invocations were required
1: https://react-lm.github.io/
2: https://langchain.readthedocs.io/en/latest/modules/agents/im...
Re: ChatGPT has trouble giving an answer before explaining its reasoning
#9The challenge here is that ChatGPT and other LLMs can only think out loud. They only "think" through writing, and that's always displayed to the user. Has anyone tried giving LLMs a scratchpad where the model could e.g. run the pipeline in order, generate the poem, and then explicitly publish it to the user without showing the earlier steps?
You can ask GPT what would be a result of executing a python program, for which a multiple step calculation is needed. It will readily output the result, with no thinking aloud.
Re: ChatGPT has trouble giving an answer before explaining its reasoning
#10> ChatGPT cannot give an answer that is the result of a "reasoning" before laying out the "reasoning".
This is slightly too strong a statement: it can give an answer before reasoning it out, but it only gets a single forward pass of the network to calculate that answer, so it has to be a simpler kind of answer or very obvious reasoning (intuitively, imagine it can only take "one logical step" in a forward pass).
Its answers get much better if it uses the context as a scratch pad to write down its thinking from previous passes, this is where Chain of Thought (CoT) comes in. The way language models work is they pass the output to the input over and over, each time generating one token. This means the context is really like a scratch pad recording its previous thoughts.