Live data from Hacker News

A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

effort.news

81–90 of 260 posts

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#83

> The Israeli Effective Altruist firm Irregular caused unsecured AI models to hack real targets. Why are we saying it this way? They did not "cause AI to hack." This phrasing in analogous to saying "caused the bullet to fire into" instead of "shot."

> They did not "cause AI to hack. You do not know what they did or didn't do, you are just parroting a narritive that makes you feel comfortable. I do not know either, but I am not asserting facts as if I have first hand knowledge of the details.

The details don't matter. If you use a machine to commit murder, then you have committed murder, not the machine. The user is responsible, and the article's phrasing is an attempt to obscure that fact.

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#84
post #33

This specific analysis seems to have some basic problems, but I think a lot of us sense a degree of coordination here culminating in Dario’s letter. If you were to work backward from “we need to lower training costs so that we can go public and make trillions” then you might come up with a plan similar to what we have seen.

It has nothing to do with lowering training costs: Dario want a moat (a monopoly or duopoly or similar) protecting his business.

His entire business model was "race to develop AI before anyone, get a monopoly on it. It's just like how Uber's (or many other startup) investors gave them tons of money and raced (violating tons of laws) to "get their first". Now that they have, they have a duopoly with Lyft, and they can pay back their VC investors by making tons of money with that duopoly.

Dario failed: local LLMs are catching up to frontier models extremely fast, which means even if Anthropic builds (say) a great coding tool, they'll only be one of many coding tool offerings: users can use Open AI or any one of the (increasingly capable) local LLMs.

So what does he doe, give up and let his business (which needs to make billions of dollars very quickly, or he won't be able to pay the bills and his company will collapse) fail? Of course not: he needs a new moat (the one he imagined he'd get by "being there first" failed).

That is where all this "AI is dangerous" BS comes in. If the US government regulates AI, local LLMs suffer, while big players like Anthropic and Open AI become the only contenders to play in that newly regulated space. Now Dario has the moat he wants, to protect his business and force everyone to pay him.

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#85

This is interesting and might be a good reason to stop working with Irregular. But I assume the alignment people want models not to hack other companies, even if they get put in a badly configured sandbox.

or rather, hack just enough and within what the user asks and not more.

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#86

[flagged]

[flagged]

Hmm one of the major relevant cultural values seems to be nepotism, though. Which is common across many cultures and I personally believe it's human nature so I'm not knocking it, per se. I wish I could nepotism too!

So are you recommending that, for example, protestants of German descent begin preferentially funding or buying from people in their in-group? People of anglo descent should start preferring other anglos? Catholics should buy from catholics?

I think the issue is that it's considered okay for some groups to do it while simultaneously being considered EXTREMELY EVIL for other groups to do it.

We can't really recommend that other groups do it with a straight face, they would be instantly shunned and vilified.

EDIT: When I say BUY I mean B2B deals, not consumer level, hence "funding or buying". Sorry for the confusion.

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#88
post #33

This specific analysis seems to have some basic problems, but I think a lot of us sense a degree of coordination here culminating in Dario’s letter. If you were to work backward from “we need to lower training costs so that we can go public and make trillions” then you might come up with a plan similar to what we have seen.

It has nothing to do with lowering training costs: Dario want a moat (a monopoly or duopoly or similar) protecting his business. His entire business model was "race to develop AI before anyone, get a monopoly on it. It's just like how Uber's (or many other startup) investors gave them tons of money and raced (violating tons of laws) to "get their first". Now that they have, they have a duopoly with Lyft, and they can…

thats not a very convincing model. as long as training data and compute is available people are going to be able to make serviceable alternatives

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#90

Why was this post flagged? This site has become ridiculous, people are routinely abusing the flagging system to take down posts they don’t like even if they’re obviously on topic and relevant to HN. And it seems like some users have substantially more flagging weight because these posts, likely this one, are often top 5 on HN.

What's ridiculous is the constant complaints about flagging and downvoting. It's bad form. If you think something was flagged when it shouldn't have been, vouch for it.

Seems like people who complain are unaware that anyone with a modicum of karma can flag and down vote.

Post reply on HN