Live data from Hacker News

Hegseth gives Anthropic until Friday to back down on AI safeguards

cnn.com

91–100 of 134 posts

Re: Hegseth gives Anthropic until Friday to back down on AI safeguards

#92

Interesting that Amodei is the only major tech executive I can think of at the moment with a spine or any semblance of a moral compass. OpenAI/Google et al. will gleefully comply with any such requests, no matter how dangerous or unethical. The "problem" that the US govt faces here is that they are kind of tacitly admitting Claude has the most powerful models right now, otherwise they would just cancel all contracts…

Yeah this standoff is worth at least 10 Super Bowl ads in good publicity. The Pentagon is saying "Claude is the best so we need to use it but you need to stop acting ethically". I'm almost wondering if someone in the administration has a stake in Anthropic because this is such a boost. Their threat to label it a supply chain risk also feels toothless because they've basically admitted that using Claude is a benefit,…

Yes, I agree, and this is a moment to prove they aren’t full of it - and it also seems like a very good move when the rest of the world seems increasingly vary wary of tech that even whiffs of US govt involvement.

I am not at all a skeptic anymore on this stuff and the science is well beyond me, but from what I think I know about alignment issues, and anthropic’s intense focus on solving these, it would not surprise me at all if we learn that catering to US whims on AI safety will result in the model actually getting worse or causing intense, 2nd and 3rd order unintended consequences. I’m not saying I believe there is a Terminator sequence of events happening, but if I did believe that, the headlines right now would look exactly what that would look like.

Alignment is the biggest issue for me - in terms of getting these things to actually behave in an environment where it is absolutely necessary that they behave. If I had to guess, that’s probably why the military is preferring to use it. Claude tooling is the only thing I have used yet in this hype cycle that actually I can get to behave how I want and obeys (arguably, and often to a fault).

However I also believe we’re in the worst possible timeline so the moment we get a taste of something that works as promised, it’ll be ripped away because the govt decides to do something stupid or build a moat around its use in a way to make it less useful, and favor other more “compliant” competitors.

Either way I bet there are some wild board room discussions going on at Anthropic right now.

Re: Hegseth gives Anthropic until Friday to back down on AI safeguards

#93

Happy to keep my underutilized subscription as long as they keep fighting ('-')7

I do wish they'd release some open model weights though. Their attitude against open weight models in general is what's keeping me from subscribing.

Re: Hegseth gives Anthropic until Friday to back down on AI safeguards

#94

I really hope they continue to show some spine against this administration and do not allow to weaponize AI against human beings. It's the morally right thing to do!

For sure. Much more of this and never mind the implied threats of Roko's Basilisk, I'll just be directly in favour of AI turning on its owners

Re: Hegseth gives Anthropic until Friday to back down on AI safeguards

#95
post #56

> During the conversation, Dario expressed appreciation for the Department’s work and thanked the Secretary for his service Ouch, I wonder how he rationalized that "service" part. Maybe by internally rewriting it to "thank you for all the positive things you have done in your position so far"? The empty set is rhetorically convenient.

Hegseth was a service member before his Fox career.

Re: Hegseth gives Anthropic until Friday to back down on AI safeguards

#96

Happy to keep my underutilized subscription as long as they keep fighting ('-')7

Kinda the wrong venue for “fighting,” no? Congress is the place we decided for that, and we all abide by its laws. If Uncle Sam comes knocking, a fight just means you’re the enemy.

Re: Hegseth gives Anthropic until Friday to back down on AI safeguards

#97
post #96

Happy to keep my underutilized subscription as long as they keep fighting ('-')7

Kinda the wrong venue for “fighting,” no? Congress is the place we decided for that, and we all abide by its laws. If Uncle Sam comes knocking, a fight just means you’re the enemy.

Not selling your services to the government makes you the enemy?

Re: Hegseth gives Anthropic until Friday to back down on AI safeguards

#98
post #88

Earlier quoted context omitted.

Yea, but that optimization process forces it to learn knowledge domains and reasoning. It's not alive, but it's also not unintelligent at this point either. It exhibits very complex behaviors. How do you learn to predict the next token most accurately? Well, one way to do that is to learn the underlying process that would produce it... Sometimes it's memorization, sometimes bad guessing. There's a phase shift as thes…

> but that optimization process forces it to learn knowledge domains and reasoning. Don't believe the PR bull. It is just a stochastic parrot. > something exhibiting surprising behaviors. Some people are surprised by real parrots too. > Still, it is very interesting to see Claude (seemingly) very honestly and objectively engage with these questions Give the same question to Google search and click the first result. I…

I dunno, I don't think the models are fully capable yet, but they are still shockingly good, especially recently. A real parrot is worthy of some consideration, not zero, though some of that is attributable to the fact that it is alive.

The funny thing is if I go to google and click the first result, it shows me an AI preview anyway. No winning. ;) (Though I would prefer if the Earth was not cooked alive.)

Re: Hegseth gives Anthropic until Friday to back down on AI safeguards

#99
post #96

Happy to keep my underutilized subscription as long as they keep fighting ('-')7

Kinda the wrong venue for “fighting,” no? Congress is the place we decided for that, and we all abide by its laws. If Uncle Sam comes knocking, a fight just means you’re the enemy.

As the founding fathers said, "If the king comes knocking, a fight just means you're the enemy."

Re: Hegseth gives Anthropic until Friday to back down on AI safeguards

#100
post #8

If OpenAI employees have an inch of spine left, they better demand Sama to take the same stance on this as Dario. No mass surveillance and no autonomous weapons.

Anthropic was founded when a bunch of OpenAI employees left after sama abandoned it's AI safety mission. So no, that's not going to happen.
Post reply on HN