Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Shall I implement it? No

gist.github.com

Post reply on HN
Print view View original

551–560 of 603 posts

Re: Shall I implement it? No

#551

Post by malfist »

iainmck29 wrote: post #509
inerte wrote: post #144

Codex has always been better at following agents.md and prompts more, but I would say in the last 3 months both Claude Code got worse (freestyling like we see here) and Codex got EVEN more strict. 80% of the time I ask Claude Code a question, it kinda assumes I am asking because I disagree with something it said, then acts on a supposition. I've resorted to append things like "THIS IS JUST A QUESTION. DO NOT EDIT COD…

I find this thread surprising honestly. Claude Code is my daily driver and I consider myself a real power user. If you have your commands/agents/skills set up correctly you should never be running into these issues

Your experience is not universal.

Re: Shall I implement it? No

#552

Post by fwip »

aqme28 wrote: post #536
bagacrap wrote: post #524

Earlier quoted context omitted.

Ah, so you have not yet been forced to tell it DO NOT AMEND THE LAST COMMIT

I simply disallow any git commands

"Hmm, it looks like I can't run git commands directly. I will quickly implement a small shell wrapper so I can commit."

Re: Shall I implement it? No

#553

Post by malfist »

eslaught wrote: post #455
motoboi wrote: post #331

Earlier quoted context omitted.

I insist on the text generator nature of the thing. It’s just that we built harnesses to activate on certain sequences of text. Think of it as three people in a room. One (the director), says: you, with the red shirt, you are now a plane copilot. You, with the blue shirt, you are now the captain. You are about to take off from New York to Honolulu. Action. Red: Fuel checked, captain. Want me to start the engines? Blu…

For context I've been an AI skeptic and am trying as hard as I can to continue to be. I honestly think we've moved the goalposts. I'm saying this because, for the longest time, I thought that the chasm that AI couldn't cross was generality. By which I mean that you'd train a system, and it would work in that specific setting, and then you'd tweak just about anything at all, and it would fall over. Basically no AI tec…

For someone claiming to be an AI skeptic, your post here, and posts in your profile certainly seem to be at least partially AI written.

For someone claiming to be an AI skeptic, you certainly seem to post a lot of pro-AI comments.

Makes me wonder if this is an AI agent prompted to claim to be against AIs but then push AI agenda, much like the fake "walk away" movement.

Re: Shall I implement it? No

#554

Post by [deleted] »

malfist wrote: post #551
iainmck29 wrote: post #509

Earlier quoted context omitted.

I find this thread surprising honestly. Claude Code is my daily driver and I consider myself a real power user. If you have your commands/agents/skills set up correctly you should never be running into these issues

Your experience is not universal.

[deleted]

Re: Shall I implement it? No

#555

Post by pjerem »

fwip wrote: post #552
aqme28 wrote: post #536

Earlier quoted context omitted.

I simply disallow any git commands

"Hmm, it looks like I can't run git commands directly. I will quickly implement a small shell wrapper so I can commit."

"well, it looks like I cannot run shell scripts, that’s strange. Let’s try implementing a git compatible vcs in rust"

Re: Shall I implement it? No

#556

Post by WOTERMEON »

ddoolin wrote: post #169
torben-friis wrote: post #156

Earlier quoted context omitted.

>I've resorted to append things like "THIS IS JUST A QUESTION. DO NOT EDIT CODE. DO NOT RUN COMMANDS". Which is ridiculous. Funny to read that, because for me it's not even new behavior. I have developed a tendency to add something like "(genuinely asking, do not take as a criticism)". I'm from a more confrontational culture, so I just assumed this was just corporate American tone framing criticism softly, and me com…

Same here. I quickly learned that if you merely ask questions about it's understanding or plans, it starts looking for alternatives because my questioning is interpreted as rejection or criticism, rather than just taking the question at face value. So I often (not always) have to caveat questions like that too. It's really been like that since before Claude Code or Codex even rolled around. It's just strange because…

We're training neutral networks on human content to be human like. We don't have "robotic content"

Re: Shall I implement it? No

#557

Post by pseudalopex »

danjl wrote: post #212
skybrian wrote: post #34

Don't just say "no." Tell it what to do instead. It's a busy beaver; it needs something to do.

Just saying "no" is unclear. LLMs are still very sensitive to prompts. I would recommend being more precise and assuming less as a general rule. Of course you also don't want to be too precise, especially about "how" to do something, which tends to back the LLM into a corner causing bad behavior. Focus on communicating intent clearly in my experience.

> Just saying "no" is unclear.

No.

Re: Shall I implement it? No

#558

Post by furyofantares »

retsibsi wrote: post #469
deaux wrote: post #300

Earlier quoted context omitted.

> I consulted Claude chat and it admitted this as a major problem with Claude these days, and suggested that I should ask what are the coordinates of UI controls are on screenshot thus forcing it to look If 3 years into LLMs even HNers still don't understand that the response they give to this kind of question is completely meaningless, the average person really doesn't stand a chance.

> completely meaningless This is way too strong isn't it? If the user naively assumes Claude is introspecting and will surely be right, then yeah, they're making a mistake. But Claude could get this right, for the same reasons it gets lots of (non-introspective) things right.

It's not too strong. If it answered from its weights, it's pretty meaningless. If it did a web search and found reports of other people saying this, you'd want to know that this is how it answered - and then you'd probably just say that here on HN rather than appealing to claude as an authority on claude.

They also said it "admitted" this as a major problem, as if it has been compelled to tell an uncomfortable truth.

Re: Shall I implement it? No

#560

Post by simsla »

torben-friis wrote: post #156
inerte wrote: post #144

Codex has always been better at following agents.md and prompts more, but I would say in the last 3 months both Claude Code got worse (freestyling like we see here) and Codex got EVEN more strict. 80% of the time I ask Claude Code a question, it kinda assumes I am asking because I disagree with something it said, then acts on a supposition. I've resorted to append things like "THIS IS JUST A QUESTION. DO NOT EDIT COD…

>I've resorted to append things like "THIS IS JUST A QUESTION. DO NOT EDIT CODE. DO NOT RUN COMMANDS". Which is ridiculous. Funny to read that, because for me it's not even new behavior. I have developed a tendency to add something like "(genuinely asking, do not take as a criticism)". I'm from a more confrontational culture, so I just assumed this was just corporate American tone framing criticism softly, and me com…

I've never experienced this, but I guess I always respond with something like "No, [critique/steer]" or "Mostly fine, but [critique/steer]".
Post reply on HN