Live data from Hacker News

Anthropic says Alibaba illicitly extracted Claude AI model capabilities

reuters.com

581–590 of 1001 posts

Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities

#581
post #411

Earlier quoted context omitted.

One would think Anthropic could point Mythos at this to solve the reseller problem outright: - Purchase multiple accounts via resellers - Send messages that contain a UID - Capture these in Anthropic's logs - Shut down account. Use any metadata to identify related accounts /loop

This only shuts down the account you have bought in the first, plus a few others if it is shared. > Use any metadata to identify related accounts How does that work? I think this is the most important part to have an impact on the „thousand“ bot accounts.

They probably will route you through different accounts. So with a single account you should be able to hit hundreds-thousands of accounts.

Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities

#582
What exactly is illicit about what they did?

Legally, model output cannot be protected by IP laws whether domestic or international. The most they can hope for is civil relief which is a stretch given the literally illicit methods they used to train their models.

Ahtoropic got treated the same way it has been treating everyone else. This is the bed they made and now they, too, have to sleep in it.

Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities

#584

Earlier quoted context omitted.

Using them was allowed as fair use – it was the downloading of the pirated copies that was infringement. That's why Anthropic switched to scanning paper books.

> That's why Anthropic switched to scanning paper books. After they threw away all the tainted data from the pirated books, right?

Yes, as part of the settlement

Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities

#587

The hypocrisy of Anthropic complaining about "illicitly extracting its Claude AI model capabilities" and supporting the White House's accusation of China "stealing U.S. AI labs' intellectual property on an industrial scale" is hilarious. Anthropic, OpenAI, Google, Microsoft, et al trained their models by ignoring the rights of copyright holders when harvesting whatever content they could. Now one of them is crying fo…

The AI companies seem to take the viewpoint that everything on the internet is free, except their stuff. It's okay to hammer some random website with AI crawlers, ignoring robots.txt, and causing bandwidth costs to skyrocket. But if you cost an AI provider money with your data acquisition practices, well, that's just clearly unacceptable.

Anthropic, Dario especially seems have eternal grudge against China as a concept, that remind me of Thiel.

Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities

#589
post #346

Earlier quoted context omitted.

> What makes the accounts fraudulent? Fake identity? And general deception about the use

Terms of use is local US fiction of wishful thinking. Nobody cares. You make something available, it's up to the consumer to decide how are they gonna use it. You don't want people to use your stuff how they please? Get off the market.

Obviously wrong on all counts: the company cares. Just like isn't not up to the consumer since the provider can restrict said consumer's access, report those actions to the authorities etc. Lastly, don't like it? Get off the provider?

Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities

#590
post #472

There's two basic kinds of distillation: 1) the massive [and dumb] method where you ask a question and use the answer as reinforcement (Black Box), and 2) more targeted distillation where you use one model to directly inform/train/guide another model (RLAIF). The latter is basically fine-tuning the model with direction from another model. Thousands of businesses do this every day to fine-tune. This is almost certainl…

Stupid question: I was under the impression that these models were trained on PB of data. Surely the amount of questions/response they can extract from querying a bigger model (Claude) is fairly modest. How is it not a drop vs the training dataset?

It's not about how big your dataset is - it's about how you use it.

I jest, but I'm also completely serious. 1T tokens from Claude can teach a model something 1T tokens scraped from the open web can't. Things like "how an LLM can problem solve effectively", or "how an LLM should use tools", or "how to construct reasoning chains", or "when to double check", or "what innate capabilities an LLM can or can't rely on".

Those are valuable things that Anthropic's own team spent a lot of effort post-training into Claude. Distillation allows them to be extracted and transferred to an otherwise unremarkable base model.

Post reply on HN