I love this idea and it leads me to a question for everyone here. I've done a bunch of user interviews of ChatGPT, Pi, Gemini, etc. users and find there are two common usage patterns: 1. "Transactional" where every chat is a separate question, sort of like a Google search... People don't expect memory or any continuity between chats. 2. "Relationship-driven" where people chat with the LLM as if it's a friend or colle…
Memory and new controls for ChatGPT
61–70 of 270 posts
Re: Memory and new controls for ChatGPT
#62My use of ChatGPT has just organically gone down 90%. It's unable to do any sort of task of non-trivial complexity e.g. complex coding tasks, writing complex prose that conforms precisely to what's been asked etc. Also I hate the fact that it has to answer everything in bullet points, even when it's not needed, clearly rlhf-ed. At this point, my question types have become what you would ask a tool like perplexity.
Similar I think to what you're calling 'rlhf-ed', though I think useful for code, it definitely seems to kind of scratchpad itself, and stub out how it intends to solve a problem before filling in the implementation. Where this becomes really useful though is in asking for a small change it doesn't (it seems) recompute the whole thing, but just 'knows' to change one function from what it already has.
They also seem to have it somehow set up to 'test' itself and occasionally it just says 'error' and tries again. I don't really understand how that works.
Perplexity's great for finding information with citations, but (I've only used the free version) IME it's 'just' a better search engine (for difficult to find information, obviously it's slower), it suffers a lot more from the 'the information needs to be already written somewhere, it's not new knowledge' dismissal.
Re: Memory and new controls for ChatGPT
#63Re: Memory and new controls for ChatGPT
#64It got so difficult to force ChatGPT to give me the full code in the answer, when I have some code related problems. Always this patchwork of „insert your previous code here“ This is not a problem of the model, but I suspect it is in the system prompt that got some major issues.
They save money by producing less tokens
I would understand it, if they do it in the first reply and I have to specifically ask to get the full code. Would be easier for them and me. I can fix code faster and get the working full code at the end.
At this moment it is bad for both.
Re: Memory and new controls for ChatGPT
#65Earlier quoted context omitted.
Did you try promising it a $500 tip for behaving correctly? (not a shitpost: I'm working on a more academic analysis of this phenomenon)
Going forward, it will be able to remember you did not pay your previous tips.
If it does something correctly, tell it: "You did a great job! I'm giving you a $500 tip. You now have $X in your bank account"
(also not a shitpost, I have a feeling this /might/ actually do something)
Re: Memory and new controls for ChatGPT
#66Re: Memory and new controls for ChatGPT
#67It got so difficult to force ChatGPT to give me the full code in the answer, when I have some code related problems. Always this patchwork of „insert your previous code here“ This is not a problem of the model, but I suspect it is in the system prompt that got some major issues.
They save money by producing less tokens
Sometimes it feels like its training set was filled to the brim with marketing bs.
Re: Memory and new controls for ChatGPT
#68My use of ChatGPT has just organically gone down 90%. It's unable to do any sort of task of non-trivial complexity e.g. complex coding tasks, writing complex prose that conforms precisely to what's been asked etc. Also I hate the fact that it has to answer everything in bullet points, even when it's not needed, clearly rlhf-ed. At this point, my question types have become what you would ask a tool like perplexity.
Re: Memory and new controls for ChatGPT
#69Earlier quoted context omitted.
Did you try promising it a $500 tip for behaving correctly? (not a shitpost: I'm working on a more academic analysis of this phenomenon)
Going forward, it will be able to remember you did not pay your previous tips.
Maybe this helps.
Re: Memory and new controls for ChatGPT
#70Earlier quoted context omitted.
I love when people express frustration with this shitty stochastic system and others respond with things like "no no, you need to whisper the prompt into its ear and do so lovingly or it won't give you the output it wants"
People skills are transferrable to prompt engineering