Live data from Hacker News

Memory and new controls for ChatGPT

openai.com

61–70 of 270 posts

Re: Memory and new controls for ChatGPT

#61
post #2

I love this idea and it leads me to a question for everyone here. I've done a bunch of user interviews of ChatGPT, Pi, Gemini, etc. users and find there are two common usage patterns: 1. "Transactional" where every chat is a separate question, sort of like a Google search... People don't expect memory or any continuity between chats. 2. "Relationship-driven" where people chat with the LLM as if it's a friend or colle…

For me it’s a combination of transactional and topical. By topical, I mean that I have a couple of persistent topics that I think on and work on (like writing an article on a topic), and I like to return to those conversations so that the context is there.

Re: Memory and new controls for ChatGPT

#62
post #38

My use of ChatGPT has just organically gone down 90%. It's unable to do any sort of task of non-trivial complexity e.g. complex coding tasks, writing complex prose that conforms precisely to what's been asked etc. Also I hate the fact that it has to answer everything in bullet points, even when it's not needed, clearly rlhf-ed. At this point, my question types have become what you would ask a tool like perplexity.

I haven't really tried to use it for coding, other than once (recently, so not before some decline) indirectly, which I was pretty impressed with: I asked about analyst expectations for the Bank of England base rate, then asked it to compare a fixed mortgage with a 'tracker' (base rate + x; always x points over the base rate). It spat out the repayment figures and totals over the two years, with a bit of waffle, and gave me a graph of cumulative payments for each. Then I asked to tweak the function used for the base rate, not recalling myself how to describe it mathematically, and it updated the model each time answering me in terms of the mortgage.

Similar I think to what you're calling 'rlhf-ed', though I think useful for code, it definitely seems to kind of scratchpad itself, and stub out how it intends to solve a problem before filling in the implementation. Where this becomes really useful though is in asking for a small change it doesn't (it seems) recompute the whole thing, but just 'knows' to change one function from what it already has.

They also seem to have it somehow set up to 'test' itself and occasionally it just says 'error' and tries again. I don't really understand how that works.

Perplexity's great for finding information with citations, but (I've only used the free version) IME it's 'just' a better search engine (for difficult to find information, obviously it's slower), it suffers a lot more from the 'the information needs to be already written somewhere, it's not new knowledge' dismissal.

Re: Memory and new controls for ChatGPT

#64

It got so difficult to force ChatGPT to give me the full code in the answer, when I have some code related problems. Always this patchwork of „insert your previous code here“ This is not a problem of the model, but I suspect it is in the system prompt that got some major issues.

They save money by producing less tokens

And I have to force them by repeating the question with different orders.

I would understand it, if they do it in the first reply and I have to specifically ask to get the full code. Would be easier for them and me. I can fix code faster and get the working full code at the end.

At this moment it is bad for both.

Re: Memory and new controls for ChatGPT

#65
post #59

Earlier quoted context omitted.

Did you try promising it a $500 tip for behaving correctly? (not a shitpost: I'm working on a more academic analysis of this phenomenon)

Going forward, it will be able to remember you did not pay your previous tips.

What if you "actually" pay?

If it does something correctly, tell it: "You did a great job! I'm giving you a $500 tip. You now have $X in your bank account"

(also not a shitpost, I have a feeling this /might/ actually do something)

Re: Memory and new controls for ChatGPT

#67

It got so difficult to force ChatGPT to give me the full code in the answer, when I have some code related problems. Always this patchwork of „insert your previous code here“ This is not a problem of the model, but I suspect it is in the system prompt that got some major issues.

They save money by producing less tokens

Which is weird because I’m constantly asking it to make responses shorter, have fewer adjectives, fewer adverbs. There’s just so much “fluff” in its responses.

Sometimes it feels like its training set was filled to the brim with marketing bs.

Re: Memory and new controls for ChatGPT

#68
post #38

My use of ChatGPT has just organically gone down 90%. It's unable to do any sort of task of non-trivial complexity e.g. complex coding tasks, writing complex prose that conforms precisely to what's been asked etc. Also I hate the fact that it has to answer everything in bullet points, even when it's not needed, clearly rlhf-ed. At this point, my question types have become what you would ask a tool like perplexity.

This is exactly my problem. For some things it's great, but it quickly forgets things that are critical for extended work. When trying to put together and sort of complex work: it does not remember things until I remind it which can make prompts that must contain all of the conversation up to that point and create non-repeatable responses that also tend to bring in the options of it's own programming or rules that corrupt my messaging. It's very frustrating, to the point where anything beyond a simple outline is more work than it's worth.

Re: Memory and new controls for ChatGPT

#69
post #59

Earlier quoted context omitted.

Did you try promising it a $500 tip for behaving correctly? (not a shitpost: I'm working on a more academic analysis of this phenomenon)

Going forward, it will be able to remember you did not pay your previous tips.

Offer to tip to a NGO and after successfully getting what you want, say you tipped.

Maybe this helps.

Re: Memory and new controls for ChatGPT

#70
post #40

Earlier quoted context omitted.

I love when people express frustration with this shitty stochastic system and others respond with things like "no no, you need to whisper the prompt into its ear and do so lovingly or it won't give you the output it wants"

People skills are transferrable to prompt engineering

I've heard stories about people putting this garbage in their systems with prompts that say "pretty please format your answer like valid json".
Post reply on HN