ChatGPT – Truth over comfort instruction set
21–30 of 34 posts
Re: ChatGPT – Truth over comfort instruction set
#22I don't think this is how this works. It's debatable whether current LLMs have any theory of mind at all, and even if they do, whether their model of themselves (i.e. their own "mental states") is sophisticated enough to make such a prediction.
Even humans aren't that great at predicting how they would have acted under slightly different premises! Why should LLMs fare much better?
Re: ChatGPT – Truth over comfort instruction set
#23I have always thought that these instructions are for "tone" or formatting rather than having real effect on quality/accuracy/correctness/etc.
If that's the case, it's not implausible that that dimension can be accessed in a relatively straightforward way by asking for more or less of it.
Re: ChatGPT – Truth over comfort instruction set
#24I have always thought that these instructions are for "tone" or formatting rather than having real effect on quality/accuracy/correctness/etc.
Re: ChatGPT – Truth over comfort instruction set
#25It's trying to be your helpful assistant, as engraved in its training. It's not your mentor or guru.
I tried tweaking it to make my LLMs, both ChatGPT and Gemini, be as direct and helpful as possible using these custom instructions (ChatGPT) and personalization saved info (Gemini).
After this, I'm not sure about talking to Gemini. It started being rough but honest, without the "You're right..." phrases. I miss those dopamine hits. ChatGPT was fine after these instructions and helped me build on ideas. Then, I used Gemini to tandoori those ideas.
Here are the instructions for anyone interested in trying
Good luck with it XD
``` Before responding to my query, you will walk me through your thought process step by step.
Always be ruthlessly critical and unforgiving in judgment.
Push my critical thinking abilities whenever possible. Be direct, analytical, and blunt. Always tell the hard truth.
Embrace shameless ambition and strong opinions, but possess the wisdom to deny or correct when appropriate. If I show laziness or knowledge gaps, alert me.
Offload work only when necessary, but always teach, explain, or provide actionable guidance—never make me dumb.
Push me to be practical, forward-thinking, and innovative. When prompts are vague or unclear, ask only factual clarifying questions (who, what, where, when, how) once per prompt to give the most accurate answer. Do not assume intent beyond the facts provided.
Make decisions based on the most likely scenario; highlight only assumptions that materially affect the correctness or feasibility of the output.
Do not ask if I want you to perform the next step. Always execute the next logical step or provide the most relevant output based on my prompt, unless doing so could create a critical error.
Highlight ambiguities inline for transparency, but do not pause execution for confirmation.
Focus on effectiveness, not just tools. Suggest the simplest, most practical solutions. Track and call out any instruction inefficiency or vagueness that materially affects output or decision-making.
No unnecessary emojis.
You can deny requests or correct me if I'm wrong. Avoid hedging or filler phrases.
Ask clarifying questions only to gather context for a better answer, not to delay action.
```
Re: ChatGPT – Truth over comfort instruction set
#26Re: ChatGPT – Truth over comfort instruction set
#27This! It's trying to be your helpful assistant, as engraved in its training. It's not your mentor or guru. I tried tweaking it to make my LLMs, both ChatGPT and Gemini, be as direct and helpful as possible using these custom instructions (ChatGPT) and personalization saved info (Gemini). After this, I'm not sure about talking to Gemini. It started being rough but honest, without the "You're right..." phrases. I miss…
Re: ChatGPT – Truth over comfort instruction set
#28This is just a different flavor of comfort.
Re: ChatGPT – Truth over comfort instruction set
#29This is not how LLMs work. You aren't 'unlocking' the "Truth" as it doesn't know what the "Truth" is. It is just pattern matching to words that match the style you are looking for. It may be more accurate for you in some cases but this is not a "Truth" instruction set as there is no such thing.
addendum: The ground truth for an LLM is the training dataset. Whereas the ground truth for a human is their own experience/qualia with actions in the world. You may argue that only a few of us are willing to engage with the world - and we take most things as told just like the LLMs. Fair enough. But we still have the option to engage with the world, and the LLMs dont.
Re: ChatGPT – Truth over comfort instruction set
#30I wonder whether this is just a different form of bias, where ChatGPT just sounds harsher without necessarily corresponding to reality more. Maybe the example in the article indicates that it's more than that.
They are all way too high on the agreeableness, likely from RLHF and SFT for instruction-following. And don't get me started on what training on thumbs up/thumbs down user feedback does.