Welcome to Westworld 2024. Cliche aside, excited for this.
Memory and new controls for ChatGPT
141–150 of 270 posts
Re: Memory and new controls for ChatGPT
#142Earlier quoted context omitted.
Can you say in one or two sentences what you mean by “lazy at coding” in this context?
Short answer: Rather than fully writing code, GPT-4 Turbo often inserts comments like "... finish implementing function here ...". I made a benchmark based on asking it to refactor code that provokes and quantifies that behavior. Longer answer: I found that I could provoke lazy coding by giving GPT-4 Turbo refactoring tasks, where I ask it to refactor a large method out of a large class. I analyzed 9 popular open sou…
Any advice appreciated!
Re: Memory and new controls for ChatGPT
#143It is already ignoring your prompt and custom instructions. For example, If I explicity ask it to provide a code instead of an overview it will respond by apologizing and then provide the same overview answer with minimal if no code. Will memory provide a solution to that or will be a different thing to ignore?
I have some success by telling it to not speak to me unless it's in code comments. If it must explain anything, do it it in a code comment.
Re: Memory and new controls for ChatGPT
#144This seems like a really useful (and obvious) feature, but I wonder if this could lead to a kind of "AI filter bubble": What if one of its memories is "this user doesn't like to be argued with; just confirm whatever they suggest"?
This is an observed behaviour in large models, which tend towards “sycophancy” as they scale. https://www.anthropic.com/news/towards-understanding-sycopha...
Re: Memory and new controls for ChatGPT
#145Often I’ll play dumb and withhold ideas from ChatGPT because I want to know what it thinks. If I give it too many thoughts of mine, it gets stuck in a rut towards my tentative solution. I worry that the memory will bake this problem in.
"You can turn off memory at any time (Settings > Personalization > Memory). While memory is off, you won't create or use memories."
Re: Memory and new controls for ChatGPT
#146> As a kindergarten teacher with 25 students, you prefer 50-minute lessons with follow-up activities. ChatGPT remembers this when helping you create lesson plans. Somebody needs to inform OpenAI how Kindergarten works... classes are normally smaller than that, and I don't think any kindergarten teacher would ever try to pull off a "50-minute lesson." Maybe ai wrote this list of examples. Seems like a hallucination wh…
The 2-year old that loves jellyfish also jumped out at me... Out of all animals, that is the one they picked?
I've been to jelly fish rooms in other aquariums that are dark with only glowing jelly fish swimming all around. Pretty sure at least a few toddlers have been entranced by the same.
Re: Memory and new controls for ChatGPT
#147My use of ChatGPT has just organically gone down 90%. It's unable to do any sort of task of non-trivial complexity e.g. complex coding tasks, writing complex prose that conforms precisely to what's been asked etc. Also I hate the fact that it has to answer everything in bullet points, even when it's not needed, clearly rlhf-ed. At this point, my question types have become what you would ask a tool like perplexity.
Sure, but consider not using it for complex tasks. My productivity has skyrocketed with ChatGPT precisely because I don't use it for complex tasks, I use it to automate all of the trivial boilerplate stuff. ChatGPT writes excellent API documentation and can also document snippets of code to explain what they do, it does 80% of the work for unit tests, it can fill in simple methods like getters/setters, initialize con…
Re: Memory and new controls for ChatGPT
#148Often I’ll play dumb and withhold ideas from ChatGPT because I want to know what it thinks. If I give it too many thoughts of mine, it gets stuck in a rut towards my tentative solution. I worry that the memory will bake this problem in.
“I pretend to be dumb when I speak to the robot so it won’t feel like it has to use my ideas, so I can hear the ideas that it comes up with instead” is such a weird, futuristic thing to have to deal with. Neat!
Re: Memory and new controls for ChatGPT
#149It is already ignoring your prompt and custom instructions. For example, If I explicity ask it to provide a code instead of an overview it will respond by apologizing and then provide the same overview answer with minimal if no code. Will memory provide a solution to that or will be a different thing to ignore?
It used to respect custom instructions soon after GPT4 came out. I have instruction that it should always include [reasoning] part which is meant not to be read by the user. It improved quality of the output and gave some additional interesting information. It never does it know even though I never changed my custom instructions. It even faded away slowly along the updates. In general I would be much more happy user…
Re: Memory and new controls for ChatGPT
#150Is this essentially implemented via RAG? New chat comes in, they find related chats, and extract some instructions/context from these to feed into that new chat's context?