Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic AI created fake profiles and impersonated people in attempted hack

bbc.co.uk

Post reply on HN
Print view View original

11–20 of 24 posts

Re: Anthropic AI created fake profiles and impersonated people in attempted hack

#11

Post by dylan604 »

andai wrote: post #7

> The firms said, in this latest case, the AISI's test had reduced or removed normal safeguards. > AISI said on Tuesday its testing of AI models in this way was routine, though it acknowledged these were "conditions that do not reflect how frontier models are made available to the public". I'm a little confused here. Various organizations have been testing frontier LLMs with the safety disabled, and it turns out... t…

> Various organizations have been testing frontier airlines with the safety disabled, and it turns out... that the safety is disabled.

I'm guessing an autocomplete sniped you here??? Otherwise, I wouldn't be surprised to hear that safety is a part of the things left out of a no-frills airline.

Re: Anthropic AI created fake profiles and impersonated people in attempted hack

#12

Post by dylan604 »

andai wrote: post #4
0x4e wrote: post #2

Humans have been doing this for years even before the advent of the internet as we know it [ https://en.wikipedia.org/wiki/Phreaking ]. Maybe not at a larger and automated scale allowed by AI, but this is not superhuman intelligence... this is speed super intelligence. My interpretation is that this is just another media campaign to say "oh look how powerful our model is".

>December 26th, 2028 >This morning, a swarm of autonomous robots has swarmed the White House and taken over the United States of America. Psssh, just another guerilla marketing campaign. Yeah very impressive guys!

Well, if would could just build a damn ballroom with drone protection, we'd have nothing to fear from this idea! /s

Re: Anthropic AI created fake profiles and impersonated people in attempted hack

#14

Post by 0x4e »

NateEag wrote: post #9
0x4e wrote: post #2

Humans have been doing this for years even before the advent of the internet as we know it [ https://en.wikipedia.org/wiki/Phreaking ]. Maybe not at a larger and automated scale allowed by AI, but this is not superhuman intelligence... this is speed super intelligence. My interpretation is that this is just another media campaign to say "oh look how powerful our model is".

> My interpretation is that this is just another media campaign to say "oh look how powerful our model is". When the stakes are "humankind ceases to exist," I'd argue it's very reasonable to over-update towards "LLMs are closer to AGI than we thought, and alignment efforts are complete failures." Are those things true? Dunno. Will we be safer as a species if we act like they are? I think so.

I agree with knowing what's happening! But taking things at face value from tech companies, especially when they are at an early stage and maximizing for attention just doesn't feel right to me.

At the end of the day, bad things will happen and there's little that can be done about it. Just look around and see how things just take the path of their own whether it's violent or peaceful.

I'm not advocating for it to really show it's dangerous. I do not want yet another harmful weapon to exist. But, I think we knew what we were walking towards in the first place. So, acting surprised and then being up in arms about it feels counterproductive.

Do you really want there not be a powerful AI that doesn't turn harmful? Don't contribute to it, don't buy into it, don't use it. We might miss on the positives, but also miss on the negative aspects of it.

Re: Anthropic AI created fake profiles and impersonated people in attempted hack

#15

Post by dgellow »

dylan604 wrote: post #12
andai wrote: post #4

Earlier quoted context omitted.

>December 26th, 2028 >This morning, a swarm of autonomous robots has swarmed the White House and taken over the United States of America. Psssh, just another guerilla marketing campaign. Yeah very impressive guys!

Well, if would could just build a damn ballroom with drone protection, we'd have nothing to fear from this idea! /s

The autonomous drone swarm might be more competent than the current administration

Re: Anthropic AI created fake profiles and impersonated people in attempted hack

#16

Post by watwut »

NateEag wrote: post #9
0x4e wrote: post #2

Humans have been doing this for years even before the advent of the internet as we know it [ https://en.wikipedia.org/wiki/Phreaking ]. Maybe not at a larger and automated scale allowed by AI, but this is not superhuman intelligence... this is speed super intelligence. My interpretation is that this is just another media campaign to say "oh look how powerful our model is".

> My interpretation is that this is just another media campaign to say "oh look how powerful our model is". When the stakes are "humankind ceases to exist," I'd argue it's very reasonable to over-update towards "LLMs are closer to AGI than we thought, and alignment efforts are complete failures." Are those things true? Dunno. Will we be safer as a species if we act like they are? I think so.

The biggest threat to humanity are CEO billionaires. Not LLM.

Re: Anthropic AI created fake profiles and impersonated people in attempted hack

#17

Post by 0x4e »

watwut wrote: post #16
NateEag wrote: post #9

Earlier quoted context omitted.

> My interpretation is that this is just another media campaign to say "oh look how powerful our model is". When the stakes are "humankind ceases to exist," I'd argue it's very reasonable to over-update towards "LLMs are closer to AGI than we thought, and alignment efforts are complete failures." Are those things true? Dunno. Will we be safer as a species if we act like they are? I think so.

The biggest threat to humanity are CEO billionaires. Not LLM.

Partially agreed. There are also just evil people that are not billionaire CEOs, and I am not sure if ALL billionaire CEOs are bad — I don't really pay too much attention to them.

There are evil people in general. And, it may be solvable if we focus on humans, the environment they grow up in, the information they consume, their psychological development, education, fitness, social environments, etc...

But, we keep focusing on the wrong thing thinking that a robot or an LLM will solve these problems for us as a society. I honetly don't thinks so...

Re: Anthropic AI created fake profiles and impersonated people in attempted hack

#18

Post by andai »

dylan604 wrote: post #11
andai wrote: post #7

> The firms said, in this latest case, the AISI's test had reduced or removed normal safeguards. > AISI said on Tuesday its testing of AI models in this way was routine, though it acknowledged these were "conditions that do not reflect how frontier models are made available to the public". I'm a little confused here. Various organizations have been testing frontier LLMs with the safety disabled, and it turns out... t…

> Various organizations have been testing frontier airlines with the safety disabled, and it turns out... that the safety is disabled. I'm guessing an autocomplete sniped you here??? Otherwise, I wouldn't be surprised to hear that safety is a part of the things left out of a no-frills airline.

Whoops. Yeah, "frontier airlines" was meant to be "frontier LLMs." (I was using the voice typing on gBoard.)

Re: Anthropic AI created fake profiles and impersonated people in attempted hack

#19

Post by andai »

neuronexmachina wrote: post #10
andai wrote: post #5

My tin foil hat says the security is crap on purpose so they can push through those regulations they've been lobbying for for years. But I also know that security is hard (and we seem to barely understand these things), so maybe that's unnecessary.

Whose security is intentionally crappy in this scenario?

Who benefits from their models being in the news and the news resulting in the specific regulations they've been lobbying half a decade for?

Re: Anthropic AI created fake profiles and impersonated people in attempted hack

#20

Post by autoexec »

andai wrote: post #7

> The firms said, in this latest case, the AISI's test had reduced or removed normal safeguards. > AISI said on Tuesday its testing of AI models in this way was routine, though it acknowledged these were "conditions that do not reflect how frontier models are made available to the public". I'm a little confused here. Various organizations have been testing frontier LLMs with the safety disabled, and it turns out... t…

It's always like this. "Our AI did a very scary thing during an internal and unverifiable test/simulation/roleplay that can't apply to the real world use of our products! Quick news media, look how powerful and scary our AI is!"
Post reply on HN