Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic apologizes for invisible Claude Fable guardrails

theverge.com

Post reply on HN
Print view View original

351–360 of 489 posts

Re: Anthropic apologizes for invisible Claude Fable guardrails

#351

Post by yonaguska »

CamperBob2 wrote: post #174
solenoid0937 wrote: post #78

Earlier quoted context omitted.

Read the actual essay. I cannot possibly imagine how you come to that conclusion unless you're just arguing in bad faith.

No. You read the actual essay, then explain how we're supposed to interpret this more charitably: Frontier AI models, like airplanes, should be required to go through technical testing and auditing, and their release should be blocked or reversed as a threat to public safety if they do not meet high standards of safety. I am grateful to see the Trump administration’s Executive Order move incrementally towards a great…

I agree with your sentiment but not your conclusion. They don't want this administration specifically to have gatekeeping authority, what they want is any administration to say that they are gatekeeping, so that they can regulate the competition out of existence. Of course the actual checks and balances will be near pointless in effect, but expensive to implement nonetheless.

Re: Anthropic apologizes for invisible Claude Fable guardrails

#352

Post by scoofy »

DaSHacka wrote: post #340
maxdo wrote: post #335

Earlier quoted context omitted.

you invest billions of dollars many months of work to just everyone distill your model?

>be me >anthropic > mine the internet for data, blasting millions of blogs with scrapers >a few have to shut down, but that's just the price to pay >finally, the chatbot is ready >learn that there are EVIL cretins out there trying to scrape automated output from OUR product to build their chatbot >build in safeguards to new model to stop this >the users are mad, now the model accuses users of being bioterrorists if t…

Seriously... the gaul of people just scraping a model for free data!

Re: Anthropic apologizes for invisible Claude Fable guardrails

#353

Post by maxdo »

Ucalegon wrote: post #348
maxdo wrote: post #347

Earlier quoted context omitted.

any intellectual labor is not sustainable, if anyone can copy your data. why have microsoft, i you can just copy windows and run it?

Have you copied Windows and tried to run it? I would love to see the plain text source code that you claim to have. We all would.

half of the developing world did. guess what it stopped a bit the trend? protection.

Re: Anthropic apologizes for invisible Claude Fable guardrails

#354

Post by paulhebert »

estearum wrote: post #71
shimman wrote: post #55

Earlier quoted context omitted.

What are you referring to? The cult belief that they are ushering in a machine god or that they strictly care about making as much money as humanely possibly while ignoring the absolutely destructive impacts these companies have had on society? IMO they are using the cult messaging to distract the public so they take out all the oxygen in the room regarding people that care about the immediate impacts (climate exacer…

"Why don't they just not participate in the arms race?!" - guy who's never heard of arms races If they believe they're creating "a machine god" and that it's better it's their machine god than someone else's (which, given the other contenders, I tend to agree with), then all the corollaries you mention are mostly irrelevant. Whether you believe they're creating a machine god is irrelevant. They believe that they are.…

A lot of people would prefer nuclear deproliferation over building more nukes.

Arms races always work out great for arms dealers. Less so for the average Joe.

Re: Anthropic apologizes for invisible Claude Fable guardrails

#355

Post by kaiuhl »

jcgrillo wrote: post #297
estearum wrote: post #292

Earlier quoted context omitted.

Lol, I can name 3 specific jobs within my own company (of My company itself (possible only with AI) does the work of at least several dozen people across my hundred customers or so. Those jobs are now automated away. Does that mean you're lying , or just overly confident (and wrong) in your speculations? FWIW, I wouldn't put Sam Altman in the category of "earnest." I'm not sure if you just aren't aware that Anthropic…

[flagged]

Not sure I’ve seen someone so openly hostile on HN in a while. Read the guidelines, and please share your thoughts in better faith.

Re: Anthropic apologizes for invisible Claude Fable guardrails

#356

Post by Ucalegon »

maxdo wrote: post #353
Ucalegon wrote: post #348

Earlier quoted context omitted.

Have you copied Windows and tried to run it? I would love to see the plain text source code that you claim to have. We all would.

half of the developing world did. guess what it stopped a bit the trend? protection.

There is a difference between being able to validate a Windows license and copying Windows from source code.

If we are talking about distillation vs building from scratch, none of these are congruent to Windows. I can build my own LLM [0] and then distill off of Claude, but that is not the same as a 1:1 copy of an operating system because there was the ability to crack how licensing works. We are not seeing Windows clones, at the source level, for that reason.

Also, Linux exists. Anyone can copy that. Why doesn't that count?

[0] https://huggingface.co/docs/transformers/quicktour

Re: Anthropic apologizes for invisible Claude Fable guardrails

#357

Post by senordevnyc »

zozbot234 wrote: post #228
dnautics wrote: post #72

Earlier quoted context omitted.

public safety is downstream of distillation. If you can distill claude, then no amount of guardrails on claude will protect you from what someone can do with it.

Distillation is not a thing unless you actually have the model weights. What people misleadingly call distillation is just training on chat logs, which has always been routine practice in the industry. There's a reason why every model today talks like early releases of ChatGPT.

If most people call it that, including the big labs, then maybe…you’re just out of date?

Re: Anthropic apologizes for invisible Claude Fable guardrails

#358

Post by DANmode »

hungryhobbit wrote: post #306
DANmode wrote: post #291

Earlier quoted context omitted.

Benevolent dictators work. But, looking to a US corp to be one? That’s daft.

They do, but only for specific definitions of "work". Like, benevolent dictators in Cuba 100% raised the literacy rate by an insane amount in just a few years (something like 20% => 80%"). If you define work as "literacy", they no doubt succeeded. But if you consider the people (and children ) they tortured, raped, and murdered, suddenly literacy doesn't seem so important.

I meant in the context of a software project, for example.

Re: Anthropic apologizes for invisible Claude Fable guardrails

#359

Post by senordevnyc »

solenoid0937 wrote: post #202
CamperBob2 wrote: post #183

Earlier quoted context omitted.

It's a pretty reasonable statement if you work for Anthropic and are eyeing your stock options nervously and your competitors even more so.

Everyone that isn't a bitter cynic must be a shill.

I’ve noticed that too many HN folks seem to think that cynicism makes them more intelligent. I think it must be some kind of insecurity, about not wanting to be seen as naive or something. It’s pretty sad though, I wonder how some of these people find any peace or joy in their lives.
Post reply on HN