Earlier quoted context omitted.
> The CCP is darkside material. And which country has "Black Sites" peppered around the world to detain and interrogate people they don't like?
The US doesn't have black sites anymore and when it did, the interrogation techniques were chosen to avoid physical harm. The results were bad, we didn't like it here in the US even if they were extreme measures for extreme times and so we shut it down. It had a high error rate and generally didn't reflect what we thought was right. Meanwhile the CCP regularly abducts its own citizens and executes more people than th…
Claude Code is steganographically marking requests
651–660 of 817 posts
Re: Claude Code is steganographically marking requests
#652Earlier quoted context omitted.
Just like these distillers can learn from Claude’s output. Fair use is fair use.
I don't think Anthropic argues that distillation violates copyright. AFAIK, their position is that it violates their terms and conditions for interacting with their servers.
Re: Claude Code is steganographically marking requests
#653Re: Claude Code is steganographically marking requests
#654Earlier quoted context omitted.
Seriously, the author has clearly never had to deal with client abuse. This is a total non issue unless you are Chinese distilling lab.
Old Marv from Cocke County, Tennessee had a distilling lab too. I'm not sure if he'd have issues too. Well, probably many issues but unrelated.
Re: Claude Code is steganographically marking requests
#655There are some commentors in this thread downplaying the severity of a service provider being less than transparent about exactly what their shipped tooling does on customer's machines. That the provider's business needs necessitate the this behaviour doesn't justify their lack of honest disclosure. That honest disclosure would render the solution to their problem useless isn't my problem. If anything, that they thou…
No, please don't move past this so quick, because I'm not convinced they have the need, and in some markets (like the US) it is a violation of civil rights, to show people different content based on their ethnicity[1] because those people might have a claim that supersedes anything they might have signed or clicked-through.
That Anthropic did something they could obvious be sued for constitutional violations in multiple countries is shocking.
> what else [are] they're harvesting from my machine? PII?
Assume everything, and yet I think this is more insidious than mere exfiltration, and we should go further: The LLM can respond to these magic quote marks directly, which means it can be trained to give people bad/different advice without those markers being so visible to people using debugging tools.
That's so unethical, the laws on this potentially so severe, Anthropic could be facing unlimited damages, from any one example combined with this article, which means either they have a really stupid management team, or were given a promise of legal immunity in some way.
Neither of those things should be what you should want to base your next big idea on.
[1]: For a simple example, showing an ad for (say) mortgage offers and targeting people by race/ethnicity/gender is totally illegal, but it's also illegal if you make a list of targeting criteria that just happen to select for a protected class.
Re: Claude Code is steganographically marking requests
#656Earlier quoted context omitted.
Textbook fallacy fallacy.
Fallacy fallacy(and variants) implies there is a fallacy in the first place. If the slope is slippery, it is not a fallacy to conclude that things will slide when placed on it. Claiming something is a fallacy —when it is not— is simply a false statement of fact.
Anthropic can start censoring criticism of Dario completely independently from whether or not they censor Deepseek.
Re: Claude Code is steganographically marking requests
#657There are some commentors in this thread downplaying the severity of a service provider being less than transparent about exactly what their shipped tooling does on customer's machines. That the provider's business needs necessitate the this behaviour doesn't justify their lack of honest disclosure. That honest disclosure would render the solution to their problem useless isn't my problem. If anything, that they thou…
Whether or not you find Anthropic's behavior bad, theybhave been very loudly stating the foreign labs have been distilling their models for a while now. This seems like an obvious response to me that would be a mechanism to make that obvious.
Re: Claude Code is steganographically marking requests
#658There are some commentors in this thread downplaying the severity of a service provider being less than transparent about exactly what their shipped tooling does on customer's machines. That the provider's business needs necessitate the this behaviour doesn't justify their lack of honest disclosure. That honest disclosure would render the solution to their problem useless isn't my problem. If anything, that they thou…
From a privacy perspective, this is better described as metadata, it is not personally identifiable information (PII).
Re: Claude Code is steganographically marking requests
#659Earlier quoted context omitted.
> I love the asymmetry. Much as I hate to defend companies climbing to success and pulling up the ladder afterwards, this asymmetry you note is kind of the whole point a company would want to grow big . Growing an organization has some super-linear costs and generally sucks for most individuals living through it - including the management - but it's still considered worth it, precisely because big entities can do thi…
I disagree with your assessment that large organisations are beneficial. We can see with our current crop of large organisations that they really struggle to create anything new; most of their new products or services were developed by a small organisation and then acquired. A lot of those products are then enshittified and badly managed because large organisation politics screws things up. Large organisations are in…
Large organizations are necessary if you want things like airplanes and rockets and computers and MRI machines to exist. And if you feel you benefit from those things yourself, then large organizations that create and operate[0] them are beneficial to you, too.
> A lot of those products are then enshittified and badly managed because large organisation politics screws things up.
That's not caused by org size. It's how modern economics work because of ad-backed business models and few other things (a tangent for another time). Importantly, small orgs and especially startups are very much complicit in this - the venture capital business model in software settled around a symbiosis, where startups create toys (er, MVPs) and growth-hack the shit out of them, in hopes of winning an acquisition or IPO lottery (aka. "exit"), where a big org buys the whole thing for ${a lot}, and enshittifies it further in an attempt of extracting a positive multiple of ${a lot} from the market. Both sides know what they're doing, exits are planned from day 1, and at no point in this process "creating useful products" is ever a driving goal.
Note this symbiosis: it's a recurring theme.
> Large organisations are inefficient
In some ways. Small organizations are inefficient in others. More at the end.
> (everyone has stories of people in large organisations literally doing nothing all day).
Some (not all) cases of this are about maintaining slack in the system, which is necessary for efficiency. A system at 100% capacity is extremely fragile to breaking completely due to tiny, random workload spikes. Breakage is inefficient. Some degree of idle capacity improves overall efficiency.
> They mistreat their customers and their employees. Their executives tend to lose touch with reality, surround themselves with yes-folk and descend into authoritarian psychopathy.
That description fits small business owners much better IMO. In our times, at least in non-failed western countries, there's a limit to how abusive or careless a large organization can be with their customers or employees - their very size makes them easy to target legally. It might be hard to get through their well-funded legal defense, unless the case is slam dunk, but that's still much better than the armies of small businesses flying completely under the radar, flagrantly violating basic health and safety regulations, or flat out lying to customers in their face, because they're not worth the effort of investigating.
(Of course I'm using a biased sample; I don't know many CEOs of big orgs.)
Symbiosis angle: for abusive practices they can't get away with on their own, big organizations are more than happy to outsource to small orgs and then look the other way.
--
Anyway, key point: *there is no categorical difference between "large organizations" and "small organizations". You need a certain amount of people and communication (and capital) to do high-complexity endeavors. The difference between a well-integrated big corporation, and a hundred of small businesses that kinda end up together delivering something big, is just that the latter is using the market as management layer.
And yes, you need big orgs to create things like commercial airplanes and MRIs, simply because the big org is a boundary layer, within which you have a non-market based incentive structure, and this lets you build things the free market just cannot reach on its own.
--
[0] - Airports and hospitals are themselves large organizations.
Re: Claude Code is steganographically marking requests
#660Earlier quoted context omitted.
Thanks for doing this. I had no idea the system prompt was embedding things like "avoid abstractions; three similar lines of code are better than one helper." Stuff I disagree with. Is there a way to modify these prompts e.g. by putting instructions in CLAUDE.md to override it? I know it won’t directly modify the system prompt, but it seems like CLAUDE.md should have the final say, shouldn’t it?
> I had no idea the system prompt was embedding things like "avoid abstractions; three similar lines of code are better than one helper." You ain't seen nothing yet. It used to say "Try the simplest approach first. Do not overdo it. Be extra concise." https://gist.github.com/roman01la/483d1db15043018096ac3babf5... Let's just say the words "simplest fix" trigger me to this day. > I know it won’t directly modify the sy…
To be fair the words simplest approach don't suggest a fix to anything :)