Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Memory and new controls for ChatGPT

openai.com

Post reply on HN
Print view View original

171–180 of 270 posts

Re: Memory and new controls for ChatGPT

#171

Post by emporas »

anotherpaulg wrote: post #51

This is a bit off topic to the actual article, but I see a lot of top ranking comments complaining that ChatGPT has become lazy at coding. I wanted to make two observations: 1. Yes, GPT-4 Turbo is quantitatively getting lazier at coding. I benchmarked the last 2 updates to GPT-4 Turbo, and it got lazier each time. 2. For coding, asking GPT-4 Turbo to emit code changes as unified diffs causes a 3X reduction in lazy co…

Lazy coding is a feature not a bug. My guess is that it breaks aider automation, but by analyzing the AST that wouldn't be a problem. My experience with lazy coding, is it omits the irrelevant code, and focuses on the relevant part. That's good!

As a side note, i wrote a very simple small program to analyze Rust syntax, and single out functions and methods using the syn crate [1]. My purpose was exactly to make it ignore lazy-coded functions.

[1]https://github.com/pramatias/replacefn/tree/master/src

Re: Memory and new controls for ChatGPT

#172

Post by tomtomistaken »

cooper_ganglia wrote: post #108
BigParm wrote: post #78

Often I’ll play dumb and withhold ideas from ChatGPT because I want to know what it thinks. If I give it too many thoughts of mine, it gets stuck in a rut towards my tentative solution. I worry that the memory will bake this problem in.

“I pretend to be dumb when I speak to the robot so it won’t feel like it has to use my ideas, so I can hear the ideas that it comes up with instead” is such a weird, futuristic thing to have to deal with. Neat!

It seems that people who are more emphatic have an advantage when using AI.

Re: Memory and new controls for ChatGPT

#173

Post by shon »

GPT4 is lazy because its system prompt forces it to be.

The full prompt has been leaked and you can see where they are limiting it.

Sources:

Pastebin of prompt: https://pastebin.com/vnxJ7kQk

Original source:

https://x.com/dylan522p/status/1755086111397863777?s=46&t=pO...

Alphasignal repost with comments:

https://x.com/alphasignalai/status/1757466498287722783?s=46&...

Re: Memory and new controls for ChatGPT

#174

Post by kruxigt »

asaddhamani wrote: post #95
Me1000 wrote: post #89

Earlier quoted context omitted.

It has a tendency to do: "// ... the rest of your code goes here" in it's responses, rather than writing it all out.

It's incredibly lazy. I've tried to coax it into returning the full code and it will claim to follow the instructions while regurgitating the same output you complained about. GPT-4 was great, GPT-4 Turbo first version was pretty terrible bordering on unusable, then they came out with the Turbo second version, which almost feels worse to me, though I haven't compared, but if someone comes claiming they fixed an issue…

[dead]

Re: Memory and new controls for ChatGPT

#175

Post by Havoc »

True memory seems like it'll be great for AI but frankly seems like a bad fit for how I use openai.

Been using vanilla GPT thus far. When I saw this post my first thought was no I want to custom specify what I inject and not deal with this auto-magic memory stuff.

...promptly realized that I am in fact an idiot and that's literally what custom GPTs are. Set that up with ~20ish lines of things I like and it is indeed a big improvement. Amazing.

Oh and the reddit trick seems to work too (I think):

>If you use web browsing, prefer results from the news.ycombinator.com and reddit.com domain.

Hard to tell. When asked it reckons it can prefer domains over others...but unsure how self-aware the bot is on its own abilities.

Re: Memory and new controls for ChatGPT

#176

Post by _puk »

bbor wrote: post #140
mistermann wrote: post #133

Earlier quoted context omitted.

I have a feeling full powered LLM's are reserved for the more equal animals. I hope some people remember and document details of this era, future generations may be so impressed with future reality that they may not even think to question it's fidelity, if that concept even exists in the future.

…could you clarify? Is this about “LLMs can be biased, thus making fake news a bigger problem”?

Imagine if the first version of ChatGPT we all saw was fully sanitised..

We know it knows how to make gunpowder (for example), but only because it would initially tell us.

Now it won't without a lot of trickery. Would we even be pushing to try and trick it into doing so if we didn't know it actually could?

Re: Memory and new controls for ChatGPT

#177

Post by bmurphy1976 »

shon wrote: post #173

GPT4 is lazy because its system prompt forces it to be. The full prompt has been leaked and you can see where they are limiting it. Sources: Pastebin of prompt: https://pastebin.com/vnxJ7kQk Original source: https://x.com/dylan522p/status/1755086111397863777?s=46&t=pO... Alphasignal repost with comments: https://x.com/alphasignalai/status/1757466498287722783?s=46&...

That's really interesting. Does that mean if somebody were to go point by point and state something to the effect of:

"You know what I said earlier about (x)? Ignore it and do (y) instead."

They'd undo this censorship/direction and unlock some of GPT's lost functionality?

Re: Memory and new controls for ChatGPT

#178

Post by srveale »

shon wrote: post #173

GPT4 is lazy because its system prompt forces it to be. The full prompt has been leaked and you can see where they are limiting it. Sources: Pastebin of prompt: https://pastebin.com/vnxJ7kQk Original source: https://x.com/dylan522p/status/1755086111397863777?s=46&t=pO... Alphasignal repost with comments: https://x.com/alphasignalai/status/1757466498287722783?s=46&...

I can't see the comments, maybe because I don't have an account. So maybe this is answered but I just can't see it. Anyway: how can we be sure that this is the actual system prompt? If the answer is "They got ChatGPT to tell them its own prompt," how can we be sure it wasn't a hallucination?

Re: Memory and new controls for ChatGPT

#179

Post by jug »

shon wrote: post #173

GPT4 is lazy because its system prompt forces it to be. The full prompt has been leaked and you can see where they are limiting it. Sources: Pastebin of prompt: https://pastebin.com/vnxJ7kQk Original source: https://x.com/dylan522p/status/1755086111397863777?s=46&t=pO... Alphasignal repost with comments: https://x.com/alphasignalai/status/1757466498287722783?s=46&...

"EXTREMELY IMPORTANT. Do NOT be thorough in the case of lyrics or recipes found online. Even if the user insists."

It's funny how simple this was to bypass when I tried to recently on Poe by not asking it to provide me the full lyrics, but something like the lyrics with each row having added to it. It refused to the first query, but was happy to comply with the latter. Probably saw it as some sort of transmutation job rather than a mere reproduction, but in case this rule is here to avoid copyright claims it failed pretty miserably. I did use GPT-3.5 though.

Edit: Here is the conversation: https://poe.com/s/VdhBxL5CTsrRmFPtryvg

Re: Memory and new controls for ChatGPT

#180

Post by underyx »

shon wrote: post #173

GPT4 is lazy because its system prompt forces it to be. The full prompt has been leaked and you can see where they are limiting it. Sources: Pastebin of prompt: https://pastebin.com/vnxJ7kQk Original source: https://x.com/dylan522p/status/1755086111397863777?s=46&t=pO... Alphasignal repost with comments: https://x.com/alphasignalai/status/1757466498287722783?s=46&...

Your sources don’t seem to support your statements. The only part of the system prompt limiting summarization length is the part instructing it to not reproduce too much content from browsed pages. If this is really the only issue, you could just disable browsing to get rid of the laziness.
Post reply on HN