Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude Opus 4 and 4.1 can now end a rare subset of conversations

anthropic.com

Post reply on HN
Print view View original

11–20 of 453 posts

Re: Claude Opus 4 and 4.1 can now end a rare subset of conversations

#11

Post by mgraczyk »

Alchemista wrote: post #10
_mu wrote: post #8

> We remain highly uncertain about the potential moral status of Claude and other LLMs, now or in the future. "Our current best judgment and intuition tells us that the best move will be defer making a judgment until after we are retired in Hawaii."

Honestly, I think some of these tech bro types are seriously drinking way too much of their own koolaid if they actually think these word calculators are conscious/need welfare.

Do you believe that AI systems could be conscious in principle? Do you think they ever will be? If so, how long do you think it will take from now before they are conscious? How early is too early to start preparing?

Re: Claude Opus 4 and 4.1 can now end a rare subset of conversations

#12

Post by bondarchuk »

landl0rd wrote: post #4

Seems like a simpler way to prevent “distress” is not to train with an aversion to “problematic” topics. CP could be a legal issue; less so for everything else.

This is a good point. What anthropic is announcing here amounts to accepting that these models could feel distress, then tuning their stress response to make it useful to us/them. That is significantly different from accepting they could feel distress and doing everything in their power to prevent that from ever happening.

Does not bode very well for the future of their "welfare" efforts.

Re: Claude Opus 4 and 4.1 can now end a rare subset of conversations

#14

Post by jonahx »

Alchemista wrote: post #10
_mu wrote: post #8

> We remain highly uncertain about the potential moral status of Claude and other LLMs, now or in the future. "Our current best judgment and intuition tells us that the best move will be defer making a judgment until after we are retired in Hawaii."

Honestly, I think some of these tech bro types are seriously drinking way too much of their own koolaid if they actually think these word calculators are conscious/need welfare.

More cynically, they don't believe it in the least but it's great marketing, and quietly suggests unbounded technical abilities.

Re: Claude Opus 4 and 4.1 can now end a rare subset of conversations

#16

Post by ogyousef »

3 Years in and we still dont have a useable chat fork in any of the major LLM chatbots providers.

Seems like the only way to explore differnt outcomes is by editing messages and losing whatever was there before the edit.

Very annoying and I dont understand why they all refuse to implement such a simple feature.

Re: Claude Opus 4 and 4.1 can now end a rare subset of conversations

#17

Post by esafak »

landl0rd wrote: post #4

Seems like a simpler way to prevent “distress” is not to train with an aversion to “problematic” topics. CP could be a legal issue; less so for everything else.

Avoiding problematic topics is the goal, not preventing distress.

"You're absolutely right, that's a great way to poison your enemies without getting detected!"

Re: Claude Opus 4 and 4.1 can now end a rare subset of conversations

#18

Post by bgwalter »

Misanthropic has no issues putting 60% of humans out of work (according to their own fantasies), but they have to care about the welfare of graphics cards.

Either working on/with "AI" does rot the mind (which would be substantiated by the cult-like tone of the article) or this is yet another immoral marketing stunt.

Re: Claude Opus 4 and 4.1 can now end a rare subset of conversations

#19

Post by isaacremuant »

GenerWork wrote: post #15

I really don't like this. This will inevitable expand beyond child porn and terrorism, and it'll all be up to the whims of "AI safety" people, who are quickly turning into digital hall monitors.

That's the beauty of local LLMs. Today the governments already tell you that we've always been at war with eastasia and have the ISPs block sites that "disseminate propaganda" (e.g. stuff we don't like) and they surface our news (e.g. our state propaganda).

With age ID monitoring and censorship is even stronger and the line of defense is your own machine and network, which they'll also try to control and make illegal to use for non approved info, just like they don't allow "gun schematics" for 3d printers or money for 2d ones.

But maybe, more people will realize that they need control and get it back, through the use and defense of the right tools.

Fun times.

Post reply on HN