Live data from Hacker News

Memory and new controls for ChatGPT

openai.com

141–150 of 270 posts

Re: Memory and new controls for ChatGPT

#142
post #87

Earlier quoted context omitted.

Can you say in one or two sentences what you mean by “lazy at coding” in this context?

Short answer: Rather than fully writing code, GPT-4 Turbo often inserts comments like "... finish implementing function here ...". I made a benchmark based on asking it to refactor code that provokes and quantifies that behavior. Longer answer: I found that I could provoke lazy coding by giving GPT-4 Turbo refactoring tasks, where I ask it to refactor a large method out of a large class. I analyzed 9 popular open sou…

I have a bunch of code I need to refactor, and also write tests for. (I guess I should make the tests before the refactor). How do you do a refactor with GPT-4? Do you just dump the file in to the chat window? I also pay for github copilot, but not GPT-4. Can I use copilot for this?

Any advice appreciated!

Re: Memory and new controls for ChatGPT

#143

It is already ignoring your prompt and custom instructions. For example, If I explicity ask it to provide a code instead of an overview it will respond by apologizing and then provide the same overview answer with minimal if no code. Will memory provide a solution to that or will be a different thing to ignore?

I have some success by telling it to not speak to me unless it's in code comments. If it must explain anything, do it it in a code comment.

I’ve been telling it I don’t have any fingers and so can’t type. It’s been pretty empathetic and finishes functions

Re: Memory and new controls for ChatGPT

#144
post #43
post #25

This seems like a really useful (and obvious) feature, but I wonder if this could lead to a kind of "AI filter bubble": What if one of its memories is "this user doesn't like to be argued with; just confirm whatever they suggest"?

This is an observed behaviour in large models, which tend towards “sycophancy” as they scale. https://www.anthropic.com/news/towards-understanding-sycopha...

More "as they are fine tuned" vs "as they scale"

Re: Memory and new controls for ChatGPT

#145
post #78

Often I’ll play dumb and withhold ideas from ChatGPT because I want to know what it thinks. If I give it too many thoughts of mine, it gets stuck in a rut towards my tentative solution. I worry that the memory will bake this problem in.

Seems like this is already solved.

"You can turn off memory at any time (Settings > Personalization > Memory). While memory is off, you won't create or use memories."

Re: Memory and new controls for ChatGPT

#146

> As a kindergarten teacher with 25 students, you prefer 50-minute lessons with follow-up activities. ChatGPT remembers this when helping you create lesson plans. Somebody needs to inform OpenAI how Kindergarten works... classes are normally smaller than that, and I don't think any kindergarten teacher would ever try to pull off a "50-minute lesson." Maybe ai wrote this list of examples. Seems like a hallucination wh…

The 2-year old that loves jellyfish also jumped out at me... Out of all animals, that is the one they picked?

My local aquarium has a star fish petting area that is very popular with the toddlers.

I've been to jelly fish rooms in other aquariums that are dark with only glowing jelly fish swimming all around. Pretty sure at least a few toddlers have been entranced by the same.

Re: Memory and new controls for ChatGPT

#147
post #92
post #38

My use of ChatGPT has just organically gone down 90%. It's unable to do any sort of task of non-trivial complexity e.g. complex coding tasks, writing complex prose that conforms precisely to what's been asked etc. Also I hate the fact that it has to answer everything in bullet points, even when it's not needed, clearly rlhf-ed. At this point, my question types have become what you would ask a tool like perplexity.

Sure, but consider not using it for complex tasks. My productivity has skyrocketed with ChatGPT precisely because I don't use it for complex tasks, I use it to automate all of the trivial boilerplate stuff. ChatGPT writes excellent API documentation and can also document snippets of code to explain what they do, it does 80% of the work for unit tests, it can fill in simple methods like getters/setters, initialize con…

Is it better at those types of things than copilot? Or even just conventional boilerplate IDE plugins?

Re: Memory and new controls for ChatGPT

#148
post #78

Often I’ll play dumb and withhold ideas from ChatGPT because I want to know what it thinks. If I give it too many thoughts of mine, it gets stuck in a rut towards my tentative solution. I worry that the memory will bake this problem in.

“I pretend to be dumb when I speak to the robot so it won’t feel like it has to use my ideas, so I can hear the ideas that it comes up with instead” is such a weird, futuristic thing to have to deal with. Neat!

I try to look for one comment like this in every AI post. Because after the applications, the politics, the debates, the stock market —- if you strip all those impacts away, you’re reminded that we have intuitive computers now.

Re: Memory and new controls for ChatGPT

#149
post #134

It is already ignoring your prompt and custom instructions. For example, If I explicity ask it to provide a code instead of an overview it will respond by apologizing and then provide the same overview answer with minimal if no code. Will memory provide a solution to that or will be a different thing to ignore?

It used to respect custom instructions soon after GPT4 came out. I have instruction that it should always include [reasoning] part which is meant not to be read by the user. It improved quality of the output and gave some additional interesting information. It never does it know even though I never changed my custom instructions. It even faded away slowly along the updates. In general I would be much more happy user…

That's funny, I used the same trick of making it output an inner monologue. I also noticed that the custom instructions are not being followed anymore. Maybe the RLHF tuning has gotten to the point where it wants to be in "chatty chatbot" mode regardless of input?

Re: Memory and new controls for ChatGPT

#150

Is this essentially implemented via RAG? New chat comes in, they find related chats, and extract some instructions/context from these to feed into that new chat's context?

I'd have to play with it, but from the screenshots and description it seems like you have to _tell it_ to remember something. Then it goes into a list of "memories" and it probably does RAG on that for every response that's sent ("Do any of the user's memories apply to this question?")
Post reply on HN