"I feel like making ’90s-style t-shirts with ‘fix this code’ on the front and ‘this shirt is a munition’ on the back.”
I'd buy that shirt.
Feds freaked over Fable 5 after 'fix this code', not jailbreak, say researchers
251–260 of 382 posts
Re: Feds freaked over Fable 5 after 'fix this code', not jailbreak, say researchers
#252As an European, I really don't get where this strategy wants to take the USA to. It's pretty clear everyone is getting scared about changes like this that happen overnight, without clear reason and completely unpredictable.
Business requires a stable environment, and Trump is making everything in his power to disrupt business stability. Ultimately, I see the rest of the world (especially Europe) relying less and less on US tech. The long term damage is done.
All the US companies that used to think about the entire world (minus China) as their market will figure out that it is much smaller then they used to think.
Re: Feds freaked over Fable 5 after 'fix this code', not jailbreak, say researchers
#253Of course it isn't about that, what we see online in the "news" is completely irrelevant with reality in most cases, it's exhausting to see people parroting what giant corps & gov are saying as if it's not extremely well crafted and plain false or deceptive most of the time. It's not even about politic left or right, both sides are acting completely dumb about it, look at Google trends, people are literally being "sw…
What makes it a risky bet?
risk
Re: Feds freaked over Fable 5 after 'fix this code', not jailbreak, say researchers
#254Of course it isn't about that, what we see online in the "news" is completely irrelevant with reality in most cases, it's exhausting to see people parroting what giant corps & gov are saying as if it's not extremely well crafted and plain false or deceptive most of the time. It's not even about politic left or right, both sides are acting completely dumb about it, look at Google trends, people are literally being "sw…
What makes it a risky bet?
Because it would really increase the interest for Chinese/EU models and would even create real incentives to build models outside of the US.
Re: Feds freaked over Fable 5 after 'fix this code', not jailbreak, say researchers
#255If you set aside political menace, this is a huge problem with Anthropic's strategy. You _cannot_ say that Mythos is super dangerous and can only be rolled out to certain people, but then release Fable with anything other than bulletproof cyber denials. Clearly with LLMs, bulletproof denials are ~impossible due to the way LLMs work. So you've ended up in a situation where Anthropic are simultaneously claiming it's a…
> Clearly with LLMs, bulletproof denials are ~impossible due to the way LLMs work Exactly. AI safety is nonsensical. You cannot define the set of "bad strings". The billion monkeys with typewriters are eventually going to be able to produce them. Any "safety" system for constraining LLM output is going to have a nonzero leak rate. But on the other hand, this is also irrelevant, unless you're irresponsible enough to c…
This is correct and certain subjects are very close to if not impossible like "use versus mention", but LLM security isn't impossible. WAFs are real and have existed for a long time. Input text produces various signals and can be secured.
No security is ever perfect, but we can likely protect LLMs with WAFs that increase security to an acceptable level. Like nation-state required resources to break.
Re: Feds freaked over Fable 5 after 'fix this code', not jailbreak, say researchers
#256It's the executive branch asserting control in this space and requiring all SOTA model providers to bend the knee. Anthropic is the least capable of playing the bend the knee game so is getting the first and worst smack down
Re: Feds freaked over Fable 5 after 'fix this code', not jailbreak, say researchers
#257This is one of the things I am most afraid of.
Governments can break the progress of AI and this could be a bubble burster?
Re: Feds freaked over Fable 5 after 'fix this code', not jailbreak, say researchers
#258I find it easier, with this administration, to assume corruption first, incompetence second, maliciousness third and all other reasonings only after several rounds of reporting and evidence.
Re: Feds freaked over Fable 5 after 'fix this code', not jailbreak, say researchers
#259Of course it isn't about that, what we see online in the "news" is completely irrelevant with reality in most cases, it's exhausting to see people parroting what giant corps & gov are saying as if it's not extremely well crafted and plain false or deceptive most of the time. It's not even about politic left or right, both sides are acting completely dumb about it, look at Google trends, people are literally being "sw…
What makes it a risky bet?
The dual risks of either a) accidentally pushing a foreign competitor into the lead and losing dominant status, or b) pushing the underlying companies hard enough that they decide to relocate.
a) is specifically the risk that the export controls push companies in other countries to prefer non-US models due to the lowered risk of getting cut off from a model. The increase in revenue for non-US AI providers combined with the drop in revenue for US AI providers allows non-US providers to double down on training and reach parity or exceed US SOTA models.
b) is sort of self-explanatory. Same model as above, but when the US AI providers start seeing the revenue drop they decide to relocate internationally instead. The US would probably try to stop that, no idea how successful they would be.
Re: Feds freaked over Fable 5 after 'fix this code', not jailbreak, say researchers
#260Of course it isn't about that, what we see online in the "news" is completely irrelevant with reality in most cases, it's exhausting to see people parroting what giant corps & gov are saying as if it's not extremely well crafted and plain false or deceptive most of the time. It's not even about politic left or right, both sides are acting completely dumb about it, look at Google trends, people are literally being "sw…
What makes it a risky bet?
The assumptions are that
* "better models" will remain so signficantly more profitable for firms that have access to them that that they're effectively a "must have" for big orgs, rather than a grossly overpriced marginal gain
* said better models will only be attainable by orgs in US jurisdiction, rather than by foreign alternatives that come to be either independently or through a legally clever "cleaving" of a US-jurisdiction business interest that wants access to an eager international market
If either of those are wrong, restricting Anthropic et al to only sell to the domestic market is effectively a poison pill that makes it much harder for them to meet growth and profitability objectives and could see them lose their market-leading position sooner and more thoroughly than if they retained access to a larger market and had more flexibility.