I have wanted nothing more than this feature. The work I try to do with ChatGPT requires a longer memory than its default nature. I will get to a point where I I have 80% of what I want out of a conversation, then it forgets critical early parts of the conversation. Then it just unravels into completely forgetting everything. I want to teach ChatGPT some basic tenants and then build off of those. This will be the cle…
Memory and new controls for ChatGPT
191–200 of 270 posts
Re: Memory and new controls for ChatGPT
#192I have wanted nothing more than this feature. The work I try to do with ChatGPT requires a longer memory than its default nature. I will get to a point where I I have 80% of what I want out of a conversation, then it forgets critical early parts of the conversation. Then it just unravels into completely forgetting everything. I want to teach ChatGPT some basic tenants and then build off of those. This will be the cle…
Use api, embed history and retrieve.
Re: Memory and new controls for ChatGPT
#193This is a bit off topic to the actual article, but I see a lot of top ranking comments complaining that ChatGPT has become lazy at coding. I wanted to make two observations: 1. Yes, GPT-4 Turbo is quantitatively getting lazier at coding. I benchmarked the last 2 updates to GPT-4 Turbo, and it got lazier each time. 2. For coding, asking GPT-4 Turbo to emit code changes as unified diffs causes a 3X reduction in lazy co…
- System prompt 1: https://sharegpt.com/c/osmngsQ
- System prompt 2: https://sharegpt.com/c/9jAIqHM
- System prompt 3: https://sharegpt.com/c/cTIqAil Note: I had to nudge ChatGPT on this one.
All of this is anecdotal, but perhaps this style of prompting would be useful to benchmark.
Re: Memory and new controls for ChatGPT
#194Earlier quoted context omitted.
I have some success by telling it to not speak to me unless it's in code comments. If it must explain anything, do it it in a code comment.
I’ve been telling it I don’t have any fingers and so can’t type. It’s been pretty empathetic and finishes functions
Re: Memory and new controls for ChatGPT
#195Often I’ll play dumb and withhold ideas from ChatGPT because I want to know what it thinks. If I give it too many thoughts of mine, it gets stuck in a rut towards my tentative solution. I worry that the memory will bake this problem in.
I purposely go out of my way to start new chats to have a clean slate and not have it remember things.
Re: Memory and new controls for ChatGPT
#196This is a bit off topic to the actual article, but I see a lot of top ranking comments complaining that ChatGPT has become lazy at coding. I wanted to make two observations: 1. Yes, GPT-4 Turbo is quantitatively getting lazier at coding. I benchmarked the last 2 updates to GPT-4 Turbo, and it got lazier each time. 2. For coding, asking GPT-4 Turbo to emit code changes as unified diffs causes a 3X reduction in lazy co…
Lazy coding is a feature not a bug. My guess is that it breaks aider automation, but by analyzing the AST that wouldn't be a problem. My experience with lazy coding, is it omits the irrelevant code, and focuses on the relevant part. That's good! As a side note, i wrote a very simple small program to analyze Rust syntax, and single out functions and methods using the syn crate [1]. My purpose was exactly to make it ig…
Your link appears to be ~100 lines of code that use rust's syntax parser to search rust source code for a function with a given name and count the number of AST tokens it contains.
Your intuitions are correct, there are lots of ways that an AST can be useful for an AI coding tool. Aider makes extensive use of tree-sitter, in order to parse the ASTs of a ~dozen different languages [0].
But an AST parser seems unlikely to solve the problem of GPT being lazy and not writing the code you need.
Re: Memory and new controls for ChatGPT
#197Haha of course this news comes just after I wrote a parser for my ChatGPT dump and generate offline embeddings for it with Phi 2 to help generate conversation metadata.
so far you can't search your whole conversation history, so your tool is relevant for a few more weeks. is it open source?