Google denies training Bard on ChatGPT chats from ShareGPT

From OpenAI's terms:

(c) Restrictions. You may not (i) use the Services in a way that infringes, misappropriates or violates any person’s rights; (ii) reverse assemble, reverse compile, decompile, translate or otherwise attempt to discover the source code or underlying components of models, algorithms, and systems of the Services (except to the extent such restrictions are contrary to applicable law); (iii) use output from the Services to develop models that compete with OpenAI;

(j) Equitable Remedies. You acknowledge that if you violate or breach these Terms, it may cause irreparable harm to OpenAI and its affiliates, and OpenAI shall have the right to seek injunctive relief against you in addition to any other legal remedies.

Those two very clearly establish that if you use the output of their service to develop your own models, then you are in breach of the terms and they can seek injunctive relief against you (stop you from working until the case is resolved).

This was seen as deeply embarrassing for Microsoft at the time.

For some cases sure, if it repurposes your code that ignores the license fine. But it's rarely wholesale copying. It's finding patterns same as anyone studying the code base would do.

As for the majority of content written on the internet through reddit or some social media, what's the harm in ingesting that? It's an incredibly useful tool that will add huge value to everyone. It's relatively open, cheap and highly available. It's worth to it's owners is only a fraction of the value it will add to society. It has the chance to have as big of an impact on progress as something like the microprocessor.

I agree it's free game for other llms to use gpt output as training data and that's positive. Although it signals desperation and panic that the largest "ai first" company with more data than any org in history is caught so flat footed and has to rely on it.

Do you really think it would be a better world in which a large LLM would never be able to be developed?

Besides who cares, train your models on whatever makes them better, tenuous TOSes be dammed.