Is it going to be as open as the (not-at-all)OpenAI?
less
Kai Fu Lee's New AI Company: Yi-Open Source
51–60 of 80 posts
Re: Kai Fu Lee's New AI Company: Yi-Open Source
#52What is ai2.0? I have never heard this notion.
What happened to WEB 3.0? Are we there yet? https://en.wikipedia.org/wiki/Web3
Painfully, years ago I wrote a book with Web 3.0 in the title. For me that meant semantic web and linked data.
I am enjoying reading this entire thread. For AI skeptics: I am not trying to talk you into anything you don’t believe, but just as an experiment, whenever you think about LLMs, appreciate how well they generalize past things they have been trained on. Peter Norvig and a friend of his recently write an article arguing that LLMs probably meet our traditional criteria for AGI.
EDIT: I am aware of the recent paper https://arxiv.org/abs/2311.00871 that argues that LLMs have limited generalization capabilities, but I don’t agree.
Re: Kai Fu Lee's New AI Company: Yi-Open Source
#53I read the first paragraph of a paywalled article that said that the company has a $1B evaluation in less than a year. I have always been a fan - I bought his PhD Thesis to read about 40 years ago. Kai Fu Lee has had an interesting career!
What was his thesis about ?
The thesis described the Sphinx speech to text system. It ran, if I remember correctly, on a few VAX minicomputers.
In the early part of my career (first 20 years) I concentrated on tackling very difficult problems wherever I worked, accepting some failures and some successes. Reading his thesis was important to me because it gave me a feeling for trying to solve hard problems in a low resource environment (although I did have a Lisp Machine, access to a Connection Machine and a Butterfly Machine - so not terribly resource poor!)
For what it’s worth: I am in my 70s, still waste deep in AI tech, and I still look for a few people to follow to get inspired.
Re: Kai Fu Lee's New AI Company: Yi-Open Source
#54> We predict that AI 2.0 will create a platform opportunity ten times larger than the mobile internet, rewriting all software and user interfaces. I was a bit interested until I read this. If this claim is to be believed, then the company appears to be entirely out of touch with reality, and it makes claims like outperforming llama-70b seem even more incredulous.
What do you find offence with? Hip speech and yawn-2.0-s aside, I find the claim entirely defendable, given, of course, a certain set of assumptions in this very new and uncertain space.
I'm entirely ready to believe AI will soon write all apps and UI. I don't see such rewrites being a x10 market opportunity, given there's already "an app for that" even when there shouldn't be.
Re: Kai Fu Lee's New AI Company: Yi-Open Source
#55Kai Fu Lee has so many terrible takes. Some things he says are borderline delusional.
His book AI Superpowers is frontloaded with a lot of "Ra Ra mighty China inevitably will win the AI competition" stuff. I just felt sad for him if AI nationalism is his genuine world view, and not just some party line he has to parrot to appease the commissars.
Let's not discount folks just because they are patriotic. A lot of people (including ones you probably do respect) fall into that pit - it's like religion, just something people also do. It doesn't change anything else they achieve.
That said, the license on the AI they produce is not open. Calling it open is dumb and for that a certain measure of disrespect is warranted.
Re: Kai Fu Lee's New AI Company: Yi-Open Source
#56Earlier quoted context omitted.
What do you find offence with? Hip speech and yawn-2.0-s aside, I find the claim entirely defendable, given, of course, a certain set of assumptions in this very new and uncertain space.
How is it defendable? How do you defend 10x? What about 11x? Why not 3.5x? This is complete bullshit.
> How is it defendable? How do you defend 10x?
Uncertainty. Given incomplete information it is common practice to make assumptions about things to give us some starting point from which to act. In this context a round integer value pretty much implies: They are estimating, and they might be completely off.
I guess you could say, "Instead of making assumptions with uncertainty, let's not assume anything", but that makes progress in new and uncertain areas really hard.
Re: Kai Fu Lee's New AI Company: Yi-Open Source
#57Earlier quoted context omitted.
What do you find offence with? Hip speech and yawn-2.0-s aside, I find the claim entirely defendable, given, of course, a certain set of assumptions in this very new and uncertain space.
I'm entirely ready to believe AI will soon write all apps and UI. I don't see such rewrites being a x10 market opportunity, given there's already "an app for that" even when there shouldn't be.
He doesn't mean AI will rewrite the apps, he means the apps/their UIs will be rewritten to use natural language input.
Re: Kai Fu Lee's New AI Company: Yi-Open Source
#58Just an FYI,the Yi license is a custom license an is not what I would describe an "open license": https://huggingface.co/01-ai/Yi-34B/blob/main/LICENSE It's non-commercial only: "If you plan to use the Yi Series Models and Derivatives for Commercial Purposes, you should contact the Licensor in advance" and "Your use of the Yi Series Models must comply with the Laws and Regulations as well as applicable legal requirem…
Yeah, getting tired of licences like this and stability AI claiming to be open source when they clearly aren't.
Re: Kai Fu Lee's New AI Company: Yi-Open Source
#59Earlier quoted context omitted.
How is it defendable? How do you defend 10x? What about 11x? Why not 3.5x? This is complete bullshit.
> How is it defendable? How do you defend 10x? Uncertainty. Given incomplete information it is common practice to make assumptions about things to give us some starting point from which to act. In this context a round integer value pretty much implies: They are estimating, and they might be completely off. I guess you could say, "Instead of making assumptions with uncertainty, let's not assume anything", but that mak…
It's a common and bad practice because quantitative language belongs in the domain of risk, not uncertainty. Two very different things. Risk is the world of stationary laws and empirical data. Fluid markets, mortality stats, that kind of thing. The "10x AI productivity boost" is about as real as the "10x engineer", that's to say, the PR department made it up. It's just vibes, but it's a symptom of a culture that unduly reveres anything that sounds "mathy".
Re: Kai Fu Lee's New AI Company: Yi-Open Source
#60Earlier quoted context omitted.
I'm entirely ready to believe AI will soon write all apps and UI. I don't see such rewrites being a x10 market opportunity, given there's already "an app for that" even when there shouldn't be.
He doesn't mean AI will rewrite the apps, he means the apps/their UIs will be rewritten to use natural language input.
I thought he meant that more interfaces will be designed to be used by AI.