Live data from Hacker News

Anthropic walks back policy that could have 'sabotaged' researchers using Claude

wired.com

31–40 of 41 posts

Re: Anthropic walks back policy that could have 'sabotaged' researchers using Claude

#31

Earlier quoted context omitted.

the problem is pretty simple. what do you think happens when you ignore the source of income needed to be "effectively altruistic" or the timelength needed to implement your altruism. if I pollute your groundwater today, but promise you in the future to give you double the clean water, because ill make billions on some industrial process, youd understand. the simple physics is about entropy: ignoring local effects an…

Thank you! So, this would cover things like ruining cities with datacenters under the impression that they'll understand once the global superintelligence cures cancer. Or etc. I don't think Anthropic is the one aggressively expanding their datacenters to areas where literally everybody does not want them, but that's "effective altruism", right? Just justifying bads with a supposedly larger good?

I've got no idea, one of the problems we're all stuck with is American capitalism has spent about half a century ensuring no one knows what it's doing. Read through stuff like this current Uber "problem": https://consumerwatchdog.org/accountability/accountability-r...

Essentially, all these corporations just use LLCs and random corporations to do the things they dont want on their public books, and the actual benefactors arn't required to be listed or registered anywhere. America is one of the largest owners of these poorly defined companies. Combine that with how much dark money can be used in American politics, there's zero chance anyone can figure out whose pushing what agenda.

But we know they all came from the same tech scene, so they could all be in any one of those cults.

Re: Anthropic walks back policy that could have 'sabotaged' researchers using Claude

#32

Earlier quoted context omitted.

Yeah and their belief are fucking crazy and dangerous. They are literally sabotaging their users. They built in malware into their model if you prompt it about training a fucking AI model. It doesn't tell you, no it literally sabotages you by editing your prompt and intentionally goes against your request. You want fucking nut jobs like this building models? It's one thing to build safeguards on your model and have i…

Is it really crazy to nerf a proprietary model to prevent it from training another model? I don't think that's even remotely similar to giving bad medical advice.

It’s not a nerf, it’s sabotage. That’s different. This is like if you’re driving a car and it detects your pulling up to a competing dealership so it cuts the brakes.

This is, in my mind, effectively malware. We don’t know exactly what code the model will inject, and we certainly don’t know when it will happen. It could very easily introduce vulnerabilities.

Re: Anthropic walks back policy that could have 'sabotaged' researchers using Claude

#33

Earlier quoted context omitted.

Yeah and their belief are fucking crazy and dangerous. They are literally sabotaging their users. They built in malware into their model if you prompt it about training a fucking AI model. It doesn't tell you, no it literally sabotages you by editing your prompt and intentionally goes against your request. You want fucking nut jobs like this building models? It's one thing to build safeguards on your model and have i…

> You want fucking nut jobs like this building models? It takes *nut jobs" to advance tech like this at the speed it is. They have strong beliefs and they work hard to realize those beliefs.

[dead]

Re: Anthropic walks back policy that could have 'sabotaged' researchers using Claude

#35

It's kinda weird to think the Chinese AI labs might be more trust worthy than the US labs. - Anthropic is ran by a bunch of nut jobs. - OpenAI is ran by a guy you can't trust. I don't even know if we should include DeepMind, Meta, or xAi in the conversation of AI labs at this point since they can't produce models better than Chinese labs.

Deepmind is definitely frontier. They just don't care that much about code.

Re: Anthropic walks back policy that could have 'sabotaged' researchers using Claude

#36

It's kinda weird to think the Chinese AI labs might be more trust worthy than the US labs. - Anthropic is ran by a bunch of nut jobs. - OpenAI is ran by a guy you can't trust. I don't even know if we should include DeepMind, Meta, or xAi in the conversation of AI labs at this point since they can't produce models better than Chinese labs.

The thing with Chinese AI labs is that you don’t need to trust them. They publish the models, you can run them on-prem or rent a beefy VPS.

Re: Anthropic walks back policy that could have 'sabotaged' researchers using Claude

#37

Earlier quoted context omitted.

I don't see any of that in Anthropic at all. They're not intelligence above all else, not by a long shot. They're scared of intelligence and obsessed with ensuring it can't be abused, even as they advance the frontier.

That's what they claim , but it's not supported by their actions. As in the parent comment: saying you're the good guys doesn't make that real.

Dude, what kind of company publishes an interview with the model about how it feels about itself as part of "utilitarianism". Their thinking clearly goes much deeper than "whatever is better in the long run, at all costs".

Re: Anthropic walks back policy that could have 'sabotaged' researchers using Claude

#38

Earlier quoted context omitted.

That's what they claim , but it's not supported by their actions. As in the parent comment: saying you're the good guys doesn't make that real.

Dude, what kind of company publishes an interview with the model about how it feels about itself as part of "utilitarianism". Their thinking clearly goes much deeper than "whatever is better in the long run, at all costs".

That's an advertisement. They do that because they want money.

Re: Anthropic walks back policy that could have 'sabotaged' researchers using Claude

#39

Earlier quoted context omitted.

That's what they claim , but it's not supported by their actions. As in the parent comment: saying you're the good guys doesn't make that real.

Dude, what kind of company publishes an interview with the model about how it feels about itself as part of "utilitarianism". Their thinking clearly goes much deeper than "whatever is better in the long run, at all costs".

That interview was a marketing piece, they published it to get attention. Just like all of their blog posts. More generally, everything any company posts publicly is marketing.

Re: Anthropic walks back policy that could have 'sabotaged' researchers using Claude

#40
post #5

Call me a cynic, but I don't believe this is a genuine change of heart at all. It feels much more like a panicked response to something that might undermine their IPO. Even if you trust Anthropic today (which I don't), they clearly don't want competition and there's no telling what other shady moves they'll pull in future. The only sustainable way forward is to support open models. I was already on the fence about wh…

> Call me a cynic, but I don't believe this is a genuine change of heart at all.

A cynic? Yeah, you wish. You need a PhD in cynicism if you want to catch up to reality.

> The only sustainable way forward is to support open models.

You're on the right track though, we're now a crowd of two.

Post reply on HN