Live data from Hacker News

Claude Code Opus 4.7 keeps checking on malware

news.ycombinator.com

41–50 of 72 posts

Re: Claude Code Opus 4.7 keeps checking on malware

#41
Some projects or tasks might become impossible to do any debugging or work on in the future, because every bug is potentially exploitable with security implications or can be twisted into something against guidelines. And they're so popular, and any bugs in them so sought for, there's a massive negative signal associated with them. LLM cannot truly infer intent from the user, an innocent request is indistinguishable from a carefully crafted scenario from bad actors, so I would never trust anyone claiming those ambiguities can be solved in their product.

If some LLMs become too strict, they'll simply be impossible to reliably use, and hopefully fail along with their providers. Claude (only reasoning models, after 4) has repeatedly refused to perform translations for text that was not lyrics (poems), it's very stupid.

Re: Claude Code Opus 4.7 keeps checking on malware

#42
> Is the newer generation going to accept that they have to please the AI?

Well obviously the narrative that is pushed is to stop learning to code, don't become a doctor, stop perusing careers in law, creative writing, and art.

Why?

AI will be doing all of these things.

What a dumb take! As if AI is the means to all ends. Hopefully the next generation will learn what AI is for and that is that is simply a tool to augment your work - not something that you 100% delegate your thinking to.

Re: Claude Code Opus 4.7 keeps checking on malware

#43
post #13

Lucky you. My new claude max account simply got instabanned. All I asked it was to build node and V8 "to investigate some node crashes" (the part I think it overindexed on) and look into a few diffs. And bam, "An internal investigation of suspicious signals associated with your account indicates a violation of our Usage Policy. As a result, we have revoked your access to Claude" They are even worse than Google, which…

Google AI studio and Gemini APIs are the least censored SOTA models.

Re: Claude Code Opus 4.7 keeps checking on malware

#44
post #33
post #10

AI killed curiosity. At least Google made you search and look at alternatives, AI just gives you solutions, whether right or wrong. In a few years, the cognitive decline will be obvious. The only people who remain curious are the people who actively want to, despite AI, and most of the time against it. Our ability to keep digging into things is entirely tied to the will of the people controlling AI to let us do so. K…

> AI killed curiosity. Only if you let yours be killed. There will always be a demand for high-value signal, even though it might not be as easy to find anymore. But then again, has it ever been? > Our ability to keep digging into things is entirely tied to the will of the people controlling AI to let us do so. I have sympathy for that argument when it comes to locked bootloaders, closed-source software etc., but wit…

> Is the existence of ChatGPT and Claude somehow preventing you personally from reading a book or looking at source code?

Microsoft owns CoPilot and controls GitHub, LinkedIn, etc

Google owns Gemini and control search results for most of the web

Meta owns whatever their model name is now and controls person-to-person relationships on the web

etc

It's up to any of them to flip the switch and make AI the default entry point when they decide that their AI isn't gaining enough traction. And then you can just hide the source data as proprietary information. Is it cynical? Sure, but I don't think we can say it's unlikely.

Re: Claude Code Opus 4.7 keeps checking on malware

#45
post #33
post #10

AI killed curiosity. At least Google made you search and look at alternatives, AI just gives you solutions, whether right or wrong. In a few years, the cognitive decline will be obvious. The only people who remain curious are the people who actively want to, despite AI, and most of the time against it. Our ability to keep digging into things is entirely tied to the will of the people controlling AI to let us do so. K…

> AI killed curiosity. Only if you let yours be killed. There will always be a demand for high-value signal, even though it might not be as easy to find anymore. But then again, has it ever been? > Our ability to keep digging into things is entirely tied to the will of the people controlling AI to let us do so. I have sympathy for that argument when it comes to locked bootloaders, closed-source software etc., but wit…

> I do see big problems around motivation of the next generation of engineers to keep looking under the hood if avoiding it is becoming so easy, but you should, individually, arguably feel more enabled to do so than ever.

This is what gets me every single time. I genuinely don’t think this is a hard realization to come to, and yet, the vast majority of arguments from both sides of the aisle, both proponents and antis, always assume that EITHER you do everything yourself, OR you have the AI do everything for you. If you use AI, you’re DOOMED to never think critically about anything anyone ever tells you ever again. If you don’t, you’re an idiot, because everyone else is using it, and skills and experience no longer matter because everyone can now do everything.

And this is on HN, too; supposedly, a site where experienced engineers, developers, and builders converge; the exact kind of demographic you’d expect to understand such a thing as nuance. And yet, your comment is one of very few. There’s someone RIGHT HERE, a few comments down, saying, verbatim, “it’s a solution engine not a curiosity engine. Getting effortless answers at every turn is the opposite of curiosity.” Treating curiosity as the end rather than the means, as if I stop being a curious person once I find an answer to a question I’ve been asking myself, or as if curiosity is some sort of “temporary status effect” that an answer/solution “consumes.”

And it seems to be worse than just “no one’s thought it through properly.” I’ve literally had someone show a fundamental incapability to understand the concept. I spent a non-trivial amount of effort writing out three comments with several paragraphs about how knowing your knowns and unknowns, and the fact that you have unknown unknowns, is the most important thing in any project, not just when it comes to AI. That these tools aren’t just doers, but also searchers. That they’re pretty much the best rubber ducky that’s ever been created, and that I argue a rubber ducky is exactly what you should be using for in any contexts that don’t have it automate trivial and testable work. The guy refused to read any of it and, after three walls of text, continued claiming I’m “advocating for the LLM to guide me.” There is some sort of deeply instinctive and intrinsically defensive reflex that a lot of people seem to immediately collapse into when the topic comes up, and it seems to seriously impair the ability to acknowledge nuance or concede a single fraction of an inch. It’s baffling.

Re: Claude Code Opus 4.7 keeps checking on malware

#46

Earlier quoted context omitted.

With scraper tech I mean a rust binary that is able to download and process thousands concurrent urls (millions per hour). Not to the same domain obviously. Paying more is not the issue here, its more the idea that an AI decides on what part of the spectrum I operate. Why is it opinionated? I am not doing anything wrong, why does it make me feel like I have to defend myself.

What is the specific concrete purpose of downloading millions of URLs per hour across different domains if it's "not doing anything wrong"?

Might be it for scrapping content for training an LLM? Oh no only big tech allowed to do it...

Re: Claude Code Opus 4.7 keeps checking on malware

#47
post #23

Opus 4.7 told me an open source program had a bug, but when i asked it for help crafting a PR or toy implementation it refused and told me i was violating Claudes TOS. I tried to plead for it to give only the most innocuous example that could not possibly work except by illustration but it continued to refuse. it would only discuss, not write any single piece of related code.

Using Claude Max was fun for more than a year but the last weeks i'm constantly fighting their Harness, their weekly TOS changes and outages. Anthropic lost all goodwill with me as a developer. I'm switching to OAI.

Re: Claude Code Opus 4.7 keeps checking on malware

#48
post #25

Earlier quoted context omitted.

Until you explore "too deep" and get your whole account banned for suspicious activity and permanently grief your whole career.

Serious fear I have. I brought it up two years ago and get downvoted when I brought it up a couple months ago. There is a story on the front page right now about someone losing their child's family videos from a youtube ban. We hear about this stuff all the time. I suspect we are gonna be in somewhat of an arms race with AI products as the bubble grows over the next 18-24 months. This makes me worried about how disad…

Happening already. My new claude max account got instabanned after just a few messages asking it to debug some stuff for me, that they felt like a TOS violation. Nothing remotely controversial. The main model didn't even complain, some dumber background censorship model flagged it.

Re: Claude Code Opus 4.7 keeps checking on malware

#49
post #14

Earlier quoted context omitted.

AI enables curious people to explore. Why do you say it kills curiosity? If anything, it's so recognizable with output I'd say it kills creativity.

It enables people to solve , not explore. It's a solution engine not a curiosity engine. Getting effortless answers at every turn is the opposite of curiosity.

I think it just changes the level where you spend your thinking.

You think things like "is the accordion a better user experience than the side tabs" instead of "why the f is the third accordion pane empty?"

Sure, the curiosity of figuring out where you made the mistake is gone, but that was never very valuable. It's just a detour that forces you to be curious about something else.

Post reply on HN