531–540 of 978 posts
Earlier quoted context omitted.
I was a little radicalized when ChatGPT literally refused to translate parts of 1000+ year old religious texts and told me it was due to copyright concerns.
Cant you in this case point out that obviously it is an old twxt and there is no copyright?
Valuations, however, are being built on the models themselves as the product.
Current state of frontier AI is a joke, with proprietary platforms attempting to grab as many users as possible, subsidizing tokens and otherwise burning VC money. This can’t be good long term, not for the consumers at least.
Earlier quoted context omitted.
It’s in the same neighborhood but isn’t really apples to apples. Distilling LLMs is to take a synthesized result that comes from huge amounts of innovation and computation, while the other is scraping what already exists as is. It is fair to say you stole our multi-billion dollar intellectual output in that scenario.
Sorry, no leg to stand on and relatively speaking no sympathy for the model makers or the data-center builders…
Earlier quoted context omitted.
This behavior is actually specific to ChatGPT because they lost a music copyright lawsuit in Germany. They would refuse to output music lyrics too but they would happily do analysis on lyrics if you supply them. I suspect there might be a guardrail model involved here.
So at the end of it, if we win enough lawsuits to demarcate some knowledge out of bounds, sufficient enough to make a difference, I wonder how that will affect the AI. Make it dumber because it does not have that data, it make it smarter since it will need to reason better with smaller knowledge base.
What's the incentive for the Chinese labs to continue releasing weights 5 years from now? In the short term it attracts talent and builds brand, but they make little money on inference to support research and training costs. Tin foil hat thinking: it also pulls inference revenue away from Antropic/OpenAI and a financial crises at those organizations improves the relative position of Chinese labs. Is there a reason to…
Engineers love to build things (just look at the whole world of open source), and building an AI model is one of the most exciting things to work on. It only takes a few million dollars of funding to produce an AI model. People spend millions on artwork and paintings for fun and prestige. I can easily see why a billionare or government would want to have their own AI model, but is not interested in the business of selling it, so they release it for free. Combined with engineering talent that loves a meaty problem like AI, I see absolutely no reason why open source AI will not continue to thrive, and not just in China.
The lesson of the last 50 years of the computer and software marketplace is that free and low-end eventually wins. - PCs destroyed minicomputers. Mainframes survive, but serving a much tinier portion of the market than they used to. - PC office productivity software destroyed expensive professional products. - Windows (low end) and Linux (free) completely destroyed the UNIX marketplace, and again, have taken huge mar…
> free and low-end eventually wins Not in SaaS which is what LLMs are. You can get VMs for much cheaper than AWS, Microsoft, and Google offer them but large companies (and startups) are happy to pay a premium for the support, reputation, and reliability that they perceive those companies as offering. Same thing for some of the managed database providers who are effectively selling a very heavily marked up version of…
Earlier quoted context omitted.
There will always be a space for perforce in a world of git. Doesn’t mean perforce is worth trillions.
That's not really my argument. It's that companies seem happy to pay a premium for a large company to provide complicated software services to them even when there are cheaper competitors.
The lesson of the last 50 years of the computer and software marketplace is that free and low-end eventually wins. - PCs destroyed minicomputers. Mainframes survive, but serving a much tinier portion of the market than they used to. - PC office productivity software destroyed expensive professional products. - Windows (low end) and Linux (free) completely destroyed the UNIX marketplace, and again, have taken huge mar…
> in 10-15 years, we are going to have consumer PCs (and phones!) running models doing pretty much anything that frontier models can do right now. The way things are going with regards to RAM/storage prices, I highly doubt that anyone but the richest among us will be able to afford them.
Earlier quoted context omitted.
So, OpenAI and Anthropic say the Chinese models are only as good because they distill their models. How true is that. I am sure it adds something. But is it more like a marginal 1% improvement or something really significant?
I also don't believe it, if it was as easy as that, we would have hundreds of competitors. The truth that Anthropic and OpenAI will not say, is that these Chinese labs have a lot of talented people.
They can invent it. They can build it. And it is only a matter of them before they can scale that last barrier of American hegemony- market it.