Live data from Hacker News

Memory and new controls for ChatGPT

openai.com

101–110 of 270 posts

Re: Memory and new controls for ChatGPT

#101
post #52

Earlier quoted context omitted.

Did you try promising it a $500 tip for behaving correctly? (not a shitpost: I'm working on a more academic analysis of this phenomenon)

Interesting, promising sexual services doesn't work anymore?

That might violate OpenAI's content policies.

Re: Memory and new controls for ChatGPT

#102

Earlier quoted context omitted.

I think it’s less of a 2D structure and more of a tree structure that you are describing. I’ve also felt the need of having “threads” with ChatGPT that I wish I could follow.

Yeah thats probably a better way of putting it. Like a lot of times I find myself wanting to branch off of the same answer with different questions, and I worry that if I ask them all sequentially chatgpt will lose 'focus'.

you can go back and edit an answer, which then creates a separate "thread". clicking left / right on that edited answer will reload the subsequent replies that came from that specific version of the answer

Re: Memory and new controls for ChatGPT

#103
post #87

This is a bit off topic to the actual article, but I see a lot of top ranking comments complaining that ChatGPT has become lazy at coding. I wanted to make two observations: 1. Yes, GPT-4 Turbo is quantitatively getting lazier at coding. I benchmarked the last 2 updates to GPT-4 Turbo, and it got lazier each time. 2. For coding, asking GPT-4 Turbo to emit code changes as unified diffs causes a 3X reduction in lazy co…

Can you say in one or two sentences what you mean by “lazy at coding” in this context?

Short answer: Rather than fully writing code, GPT-4 Turbo often inserts comments like "... finish implementing function here ...". I made a benchmark based on asking it to refactor code that provokes and quantifies that behavior.

Longer answer:

I found that I could provoke lazy coding by giving GPT-4 Turbo refactoring tasks, where I ask it to refactor a large method out of a large class. I analyzed 9 popular open source python repos and found 89 such methods that were conceptually easy to refactor, and built them into a benchmark [0].

GPT succeeds on this task if it can remove the method from its original class and add it to the top level of the file with appropriate changes to the size of the abstract syntax tree. By checking that the size of the AST hasn't changed much, we can infer that GPT didn't replace a bunch of code with a comment like "... insert original method here...". The benchmark also gathers other laziness metrics like counting the number of new comments that contain "...". These metrics correlate well with the AST size tests.

[0] https://github.com/paul-gauthier/refactor-benchmark

Re: Memory and new controls for ChatGPT

#104
post #87

This is a bit off topic to the actual article, but I see a lot of top ranking comments complaining that ChatGPT has become lazy at coding. I wanted to make two observations: 1. Yes, GPT-4 Turbo is quantitatively getting lazier at coding. I benchmarked the last 2 updates to GPT-4 Turbo, and it got lazier each time. 2. For coding, asking GPT-4 Turbo to emit code changes as unified diffs causes a 3X reduction in lazy co…

Can you say in one or two sentences what you mean by “lazy at coding” in this context?

it was really good at some point last fall, solving problems that it had previously completely failed at, albeit after a lot of iterations via autogpt. at least for the tests i was giving it which usually involved heavy stats and complicated algorithms, i was surprised it passed. despite it passing the code was slower than what i had personally solved the problem with, but i was completely impressed because i asked hard problems.

nowadays the autogpt gives up sooner, seems less competent, and doesnt even come close to solving the same problems

Re: Memory and new controls for ChatGPT

#105
The ChatGPT web interface is so awful. Why don't they fix it??

It's sooooo slow and sluggish, it breaks constantly, it requires frequent full page reloads, sometimes it just eats inputs, there's no search, not even over titles, etc, I could go on for a while.

Re: Memory and new controls for ChatGPT

#107

> As a kindergarten teacher with 25 students, you prefer 50-minute lessons with follow-up activities. ChatGPT remembers this when helping you create lesson plans. Somebody needs to inform OpenAI how Kindergarten works... classes are normally smaller than that, and I don't think any kindergarten teacher would ever try to pull off a "50-minute lesson." Maybe ai wrote this list of examples. Seems like a hallucination wh…

The 2-year old that loves jellyfish also jumped out at me... Out of all animals, that is the one they picked?

Re: Memory and new controls for ChatGPT

#108
post #78

Often I’ll play dumb and withhold ideas from ChatGPT because I want to know what it thinks. If I give it too many thoughts of mine, it gets stuck in a rut towards my tentative solution. I worry that the memory will bake this problem in.

“I pretend to be dumb when I speak to the robot so it won’t feel like it has to use my ideas, so I can hear the ideas that it comes up with instead” is such a weird, futuristic thing to have to deal with. Neat!

Re: Memory and new controls for ChatGPT

#109

Is there anything revolutionary about this “memory” feature? Looks like it’s just summarizing facts gathered during chats and adding those to the prompt they feed to the AI. I mean that works (been doing it myself) but what’s the news here?

I don't think so, just a handy feature.

Re: Memory and new controls for ChatGPT

#110
post #65
post #59

Earlier quoted context omitted.

Going forward, it will be able to remember you did not pay your previous tips.

What if you "actually" pay? If it does something correctly, tell it: "You did a great job! I'm giving you a $500 tip. You now have $X in your bank account" (also not a shitpost, I have a feeling this /might/ actually do something)

Gaslighting ChatGPT into believing false memories about itself that I’ve implanted into its psyche is going to be fun.
Post reply on HN