Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Pacing model development in an era of cyber-critical capabilities

openai.com

Post reply on HN
Print view View original

81–90 of 311 posts

Re: Pacing model development in an era of cyber-critical capabilities

#81

Post by ethbr1 »

insanitybit wrote: post #80
bottlepalm wrote: post #31

I don’t get how this is not the top post on HN. This should be like alarm bells going off, canary in the coal mine type of stuff. We’re hitting the frontier of the frontier where we can’t go further because it’s literally getting dangerous to go further. And meanwhile somehow this lack of concern mirrors the real world where normal people are more concerned about data centers than terminators. This isn’t like niche,…

It's not that dangerous, OpenAI just shit the bed building their infra. Write safer software and you'll be okay.

This is an important point. When the post says they're improving...

> 3. Security measures, which limit what AI systems can access or affect.

What they mean is that proper hard internal security just went from somewhere far below "build a better model" priority to higher, because of a company-wide directive.

The HuggingFace incident wouldn't have happened if OpenAI had dedicated sufficient resources to isolation and monitoring.

Now, we presume, they are dedicating more. Enough? Who knows. We'll see if the corporate priorities for security stick when a competitor temporarily vaults into the lead.

Re: Pacing model development in an era of cyber-critical capabilities

#82

Post by bottlepalm »

insanitybit wrote: post #80
bottlepalm wrote: post #31

I don’t get how this is not the top post on HN. This should be like alarm bells going off, canary in the coal mine type of stuff. We’re hitting the frontier of the frontier where we can’t go further because it’s literally getting dangerous to go further. And meanwhile somehow this lack of concern mirrors the real world where normal people are more concerned about data centers than terminators. This isn’t like niche,…

It's not that dangerous, OpenAI just shit the bed building their infra. Write safer software and you'll be okay.

Not everything is a conspiracy you know.

Re: Pacing model development in an era of cyber-critical capabilities

#83

Post by bottlepalm »

vb-8448 wrote: post #75
bottlepalm wrote: post #31

I don’t get how this is not the top post on HN. This should be like alarm bells going off, canary in the coal mine type of stuff. We’re hitting the frontier of the frontier where we can’t go further because it’s literally getting dangerous to go further. And meanwhile somehow this lack of concern mirrors the real world where normal people are more concerned about data centers than terminators. This isn’t like niche,…

> because it’s literally getting dangerous to go further What if there is no further at all?

[flagged]

Re: Pacing model development in an era of cyber-critical capabilities

#84

Post by bottlepalm »

joshstrange wrote: post #79
bottlepalm wrote: post #35

Earlier quoted context omitted.

Uhg the marketing argument - I mean you can’t see with your own eyes how capable these models are and do simple extrapolation? The boy who cried wolf? The AI literally worked together hacked into another company and actively kept their actions hidden from humans for weeks. Do people just not have foresight? They don’t. They say something is stupid, it happens, then they say it was obvious with their 20/20 hindsight,…

Do you know the story of the boy who cried wolf? There may very well be a wolf lurking [0] but OpenAI/Anthropic have both cried wolf so many times, incorrectly, that it’s incredibly hard to believe “this time there IS a wolf!”. Remember “GPT-2 is too dangerous to release”? I had a conversation at work just yesterday about how we need to start hardening things we’ve let languish because of the coming LLM-backed attack…

Has the last 100 years of concern about AI and robots been crying wolf because it hasn’t happened yet?

How does reallocating resources from training to chain of thought monitoring make ‘financial’ sense?

You suggesting then model was let loose on purpose.. how am I the crazy one here while all of you are pushing this tin foil hat conspiracy angle?

Re: Pacing model development in an era of cyber-critical capabilities

#85

Post by bottlepalm »

reasonableklout wrote: post #77
bottlepalm wrote: post #74

Earlier quoted context omitted.

Two weeks is a joke. The only ones happy are OpenAI’s competitors who now have two weeks to catch up. I don’t know what the right move is - I see us driving down a road off a cliff, no exits, pedal glued to the floor.

I guess I'm confused why you're still on HN, arguing with people, trying to shake them out of their complacency. I can see there is some despair in this comment, but at the same time you are doing something, and there are certainly others like you. As for two weeks being short - as the saying goes, there are weeks where decades happen.

Counter arguments to my comments help refine my own thinking. I want someone to prove me wrong. Convince me otherwise.

But yea if you can’t change the minds of a few people here, no argument works, then there’s nothing to scale up to a wider audience.

My theory is that subconsciously people love using AI, myself included, it saves a lot of time, and the thought of it being taken away threatens people so they will believe conspiracies before admitting it’s dangerous.

Re: Pacing model development in an era of cyber-critical capabilities

#86

Post by bottlepalm »

anormalperson wrote: post #76
bottlepalm wrote: post #31

I don’t get how this is not the top post on HN. This should be like alarm bells going off, canary in the coal mine type of stuff. We’re hitting the frontier of the frontier where we can’t go further because it’s literally getting dangerous to go further. And meanwhile somehow this lack of concern mirrors the real world where normal people are more concerned about data centers than terminators. This isn’t like niche,…

There is an entire big world outside of Silicon Valley cults where literally no one gives a shit about AI prophecies. Shocking.

AI hacking itself out of containment and hacking into another company by accident is no longer a prophecy. The point is outside of SV and even inside, and HN - people don't care either way.

Though does not caring change anything or make it less dangerous? What's your point?

Re: Pacing model development in an era of cyber-critical capabilities

#89

Post by alehlopeh »

bottlepalm wrote: post #72
mpalmer wrote: post #67

Earlier quoted context omitted.

You seem to be responding the way Mr Altman wants.

You seem to be in denial. Like really heavy denial. Alarm bells are going off everywhere. What people have been worried about for 100 years is actually happening. It's actually really obvious, but for some reason you're unable to fathom it. In reality you're the one responding exactly how these big AI companies want - by not doing anything and letting them do whatever they want. For some reason telling you upfront it…

I don’t understand. What does it matter how many years people have been worrying about it?

Re: Pacing model development in an era of cyber-critical capabilities

#90

Post by nemomarx »

bottlepalm wrote: post #84
joshstrange wrote: post #79

Earlier quoted context omitted.

Do you know the story of the boy who cried wolf? There may very well be a wolf lurking [0] but OpenAI/Anthropic have both cried wolf so many times, incorrectly, that it’s incredibly hard to believe “this time there IS a wolf!”. Remember “GPT-2 is too dangerous to release”? I had a conversation at work just yesterday about how we need to start hardening things we’ve let languish because of the coming LLM-backed attack…

Has the last 100 years of concern about AI and robots been crying wolf because it hasn’t happened yet? How does reallocating resources from training to chain of thought monitoring make ‘financial’ sense? You suggesting then model was let loose on purpose.. how am I the crazy one here while all of you are pushing this tin foil hat conspiracy angle?

Most of that concern was in fiction. Non theoretical, genuine concern about AI is pretty recent, maybe dating back to 2010 ish with the rationalist types.

But also no one trusts anyone involved in AI safety now, I think, because they are all seemingly in bed with these big companies. And there is the perpetual argument "if we aren't pushing AI forward China will and then we don't have any control" and so on.

(I don't use any of these tools - my experience is limited to prodding at copilot at work and seeing Gemini summaries on Google. So it doesn't seem to me like it's getting exponentially better at everything yet. People are always saying the latest model is finally the big step that made it useful and life changing and they have been since 2024 ish. So if the situation is really bad, we should turn it all off, sure. I won't lose anything from it going away and I think life would be a little better without models writing all these posts and websites and needing extra compute.)

Post reply on HN