Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Memory and new controls for ChatGPT

openai.com

Post reply on HN
Print view View original

51–60 of 270 posts

Re: Memory and new controls for ChatGPT

#51

Post by anotherpaulg »

This is a bit off topic to the actual article, but I see a lot of top ranking comments complaining that ChatGPT has become lazy at coding. I wanted to make two observations:

1. Yes, GPT-4 Turbo is quantitatively getting lazier at coding. I benchmarked the last 2 updates to GPT-4 Turbo, and it got lazier each time.

2. For coding, asking GPT-4 Turbo to emit code changes as unified diffs causes a 3X reduction in lazy coding.

Here are some articles that discuss these topics in much more detail.

https://aider.chat/docs/unified-diffs.html

https://aider.chat/docs/benchmarks-0125.html

Re: Memory and new controls for ChatGPT

#52

Post by sorokod »

minimaxir wrote: post #45
bluish29 wrote: post #28

It is already ignoring your prompt and custom instructions. For example, If I explicity ask it to provide a code instead of an overview it will respond by apologizing and then provide the same overview answer with minimal if no code. Will memory provide a solution to that or will be a different thing to ignore?

Did you try promising it a $500 tip for behaving correctly? (not a shitpost: I'm working on a more academic analysis of this phenomenon)

Interesting, promising sexual services doesn't work anymore?

Re: Memory and new controls for ChatGPT

#53

Post by minimaxir »

bfeynman wrote: post #17
minimaxir wrote: post #5

OpenAI's terminology and implementations have been becoming increasingly more nonstandard and black box such that it's making things more confusing than anything else even for people like myself who are proficient in the space. I can't imaging how the nontechnical users they are targeting with the ChatGPT webapp feel.

I would think it is intentional and brand strategy. OpenAI is such a force majeure that people will not know how to switch off of it if needed, makes their solutions more sticky. Other companies will probably adjust to their terminology just to keep up and make it easier for others to onboard.

The only term that OpenAI really popularized is "function calling", which is very poorly named to the point that they ended up abandoning it in favor for the more standard "tools".

I went into a long tangent about specifically that in this post: https://news.ycombinator.com/item?id=38782678

Re: Memory and new controls for ChatGPT

#54

Post by [deleted] »

isaacisaac wrote: post #42
__loam wrote: post #40

Earlier quoted context omitted.

I love when people express frustration with this shitty stochastic system and others respond with things like "no no, you need to whisper the prompt into its ear and do so lovingly or it won't give you the output it wants"

People skills are transferrable to prompt engineering

[deleted]

Re: Memory and new controls for ChatGPT

#55

Post by glenstein »

karaterobot wrote: post #49

What's the difference between this and the custom instructions text field they already have? I guess memories are stored with more granularity (which may not make a difference) and it's something the tool can write itself over time if you let it (and I assume it does it even if you don't). Is there anything else about it? The custom instructions have not, so far, affected my experience of using ChatGPT very much.

I think the big thing everyone wants is larger context windows, and so any new tool offering to help with memory is something that is valued to that end.

Over time, what is being offered are these little compromise tools that provide a little bit of memory retention in targeted ways, presumably because it is less costly to offer this than generalized massive context windows. But I'd still rather have those.

The small little tools make strange assumptions about intended use cases, such as the transactional/blank slate vs relationship-driven assumptions pointed out by another commenter. These assumptions are annoying, and raise general concerns about the core product disintegrating into a motley combination of one-off tools based on assumptions about use cases that I don't want to have anything to do with.

Re: Memory and new controls for ChatGPT

#56

Post by dcastm »

minimaxir wrote: post #45
bluish29 wrote: post #28

It is already ignoring your prompt and custom instructions. For example, If I explicity ask it to provide a code instead of an overview it will respond by apologizing and then provide the same overview answer with minimal if no code. Will memory provide a solution to that or will be a different thing to ignore?

Did you try promising it a $500 tip for behaving correctly? (not a shitpost: I'm working on a more academic analysis of this phenomenon)

I've tried the $500 tip idea, but it doesn't seem to make much of a difference in the quality of responses when already using some form of CoT (including zero-shot).

Re: Memory and new controls for ChatGPT

#57

Post by denysvitali »

minimaxir wrote: post #45
bluish29 wrote: post #28

It is already ignoring your prompt and custom instructions. For example, If I explicity ask it to provide a code instead of an overview it will respond by apologizing and then provide the same overview answer with minimal if no code. Will memory provide a solution to that or will be a different thing to ignore?

Did you try promising it a $500 tip for behaving correctly? (not a shitpost: I'm working on a more academic analysis of this phenomenon)

Did the tipping trend move to LLMs now? I thought there wasn't anything worse than tipping an automated checkout machine, but now I realize I couldn't be more wrong

Re: Memory and new controls for ChatGPT

#58

Post by henry2023 »

sorokod wrote: post #52
minimaxir wrote: post #45

Earlier quoted context omitted.

Did you try promising it a $500 tip for behaving correctly? (not a shitpost: I'm working on a more academic analysis of this phenomenon)

Interesting, promising sexual services doesn't work anymore?

Gpt will now remember your promises and ignore any further questions until settlement

Re: Memory and new controls for ChatGPT

#59

Post by bemmu »

minimaxir wrote: post #45
bluish29 wrote: post #28

It is already ignoring your prompt and custom instructions. For example, If I explicity ask it to provide a code instead of an overview it will respond by apologizing and then provide the same overview answer with minimal if no code. Will memory provide a solution to that or will be a different thing to ignore?

Did you try promising it a $500 tip for behaving correctly? (not a shitpost: I'm working on a more academic analysis of this phenomenon)

Going forward, it will be able to remember you did not pay your previous tips.

Re: Memory and new controls for ChatGPT

#60

Post by glenstein »

cl42 wrote: post #2

I love this idea and it leads me to a question for everyone here. I've done a bunch of user interviews of ChatGPT, Pi, Gemini, etc. users and find there are two common usage patterns: 1. "Transactional" where every chat is a separate question, sort of like a Google search... People don't expect memory or any continuity between chats. 2. "Relationship-driven" where people chat with the LLM as if it's a friend or colle…

I think this is an extremely helpful distinction, because it disentangles a couple of things I could not clearly disentangle in my own.

I think I am, and perhaps most people are, firmly transactional. And I think, in the interests of perusing "stickiness" unique to OpenAI, they are attempting to add relationship-driven/sticky bells and whistles, even though those pull the user interface as a whole toward a set of assumptions about usage that don't apply to me.

Post reply on HN