Google plans to invest up to $40B in Anthropic
561–570 of 868 posts
Re: Google plans to invest up to $40B in Anthropic
#562Earlier quoted context omitted.
If that happens catching up will be meaningless, everything we know and care about will change. You don’t have to be doomsday about it even, a self improving AI will quickly be more efficient than a human brain, all the data centers will be useless, tech companies will collapse (so will most others), everyone will have an incredible AI resource for the price of a hotdog. There’s no way it wouldn’t leak from whoever m…
> There’s no way it wouldn’t leak from whoever made it, either by people or by the AI itself. It seems pretty wild to bet the future on such an assumption. What are you even basing it on?
Re: Google plans to invest up to $40B in Anthropic
#563Earlier quoted context omitted.
GE Capital was a different creature, riding the line of fraud in some ways. They misapplied accounting rules and had to write down or capitalize over $20B for long term care insurance.
I don't know the full the history of this story, but I honestly wonder if type of scandal is still possible in the United States. After Enron and Worldcomm, the US introduced Sarbanes-Oxley reporting regulations. Additionally, after the Global Financial Crisis of 2008/2009, there was a dramatic increase in regulations for banks (of all kinds) and insurance companies.
Re: Google plans to invest up to $40B in Anthropic
#564Earlier quoted context omitted.
> To be honest, I think "vendor financing" is still a very risky premise. Are you aware that all heavy industry in all highly developed nations make extensive use of vendor financing to sell their products? Siemens is a perfect example of a well-run, stable, industrial giant. They offer vendor financing for large purchases. Same for the "heavies" (Mitsubishi, Kawasaki, IHI, Hyundai, Doosan, Hanjin) in Japan and Korea…
Are we replacing "Let me google that for you" with "Here is a prompt to feed ChatGPT" now? Edit: I am not asking whether ChatGPT is better than Google Search, I am asking after the standard dodge of citing one's sources.
Re: Google plans to invest up to $40B in Anthropic
#565Re: Google plans to invest up to $40B in Anthropic
#566Earlier quoted context omitted.
Yup. That doesn't really take a full-blown AGI on the path to ASI on the path to godhood - it'll take a bit better and more reliable LLM with a decent harness. That's why I've been saying that the entire software industry is now living on borrowed time. It'll continue at the mercy of SOTA LLM operators, for as long as they prefer to extract rent from everyone for access to "cognition as a service". In the meantime, a…
Don't open models and competition between frontier providers both serve as barriers here? If a frontier provider pivoted as you describe it would certainly change the landscape but they wouldn't be unassailable without developing some sort of secret sauce that gave them an extremely large advantage over everyone else. They'd need a sufficient advantage to pull out far ahead of everyone else before others had a chance…
Integration, and mindset. AI, by its general-purpose nature, subsumes software products. Most products today try to integrate AI inside, put it in a box and use to supercharge the product - whereas it's becoming obvious even for non-technical users, that AI is better on the outside, using the product for you. This gives the SOTA AI companies an advantage over everyone else - they're on the outside, and can assimilate products into their AI ecosystem - like the Borg collective, adding their distinctiveness to their own - and reaping outsized and compounding benefits from deep interoperability between the new capability and everything else the AI could already do.
Once one SOTA AI company starts this process, the way I see it, it's the end-game for the industry. The only players that can compete with it are the other SOTA AI companies - but this will just be another race, with nearly-equivalent offerings trading spots in benchmarks/userbase every other month - and that race starts with rapidly cannibalizing the entire software industry, as each provider wants to add new capabilities first, for a momentary advantage.
Once this process starts, I see no way for it to be stopped. Software products will stop being a thing.
Open models can't compete, because they're always lagging proprietary. What they do, however, is ensure the above happens - because if, for some reason SOTA AI companies stick to only supplying "digital smarts a service" for everyone, someone with access to sufficient compute infra is bound to eventually try the end-game strategy with an open model, hoping to get a big payday before SOTA companies respond in kind.
Either way, the way I see it, software industry as we know it is already living on borrowed time.
Re: Google plans to invest up to $40B in Anthropic
#567Earlier quoted context omitted.
> To be honest, I think "vendor financing" is still a very risky premise. Are you aware that all heavy industry in all highly developed nations make extensive use of vendor financing to sell their products? Siemens is a perfect example of a well-run, stable, industrial giant. They offer vendor financing for large purchases. Same for the "heavies" (Mitsubishi, Kawasaki, IHI, Hyundai, Doosan, Hanjin) in Japan and Korea…
Are we replacing "Let me google that for you" with "Here is a prompt to feed ChatGPT" now? Edit: I am not asking whether ChatGPT is better than Google Search, I am asking after the standard dodge of citing one's sources.
Re: Google plans to invest up to $40B in Anthropic
#568Context: a few weeks ago, Anthropic signed a deal to buy "multiple gigawatts of next-generation TPU capacity" from Google and Broadcom [1]. There have been several previous deals, too. Some people call this sort of thing a "circular deal", but perhaps a better way to think of it is as a very large-scale version of vendor financing? The simple version of vendor financing is when a vendor gives a retailer time to pay f…
Let's say Anthropic fails to pay it's debt, can Google take those TPU's back and make money from them?
Re: Google plans to invest up to $40B in Anthropic
#569Earlier quoted context omitted.
The first to AGI, or a close approximation, is the winner. That’s what the investors in Anthropic and OpenAI are betting on. I’d be willing the bet that the Venn diagram of investors in those two companies is nearly a circle.
So, what will AGI be able to do that will make that bet pay off? Human-like intelligence is already very common. Vastly better than human intelligence seems like it would be worth the expense, but I don't know where we'd get suitable training data.
Current LLMs are absolutely stupidly inefficient on this front, requiring virtually all human knowledge to train on as a prerequisite to early-college-level understanding of any one subject (granted, almost all subjects at that point, but what it has in breadth it lacks in depth).
That way instead of training millions of TPUs on petabytes of data just to get a model that maintains an encyclopedia of knowledge with a twelve-year-old's capacity for judgment, that same training set and compute could (they hope) instead far exceed the depth of judgement, planning, and vision of any human who has ever lived (ideally while keeping the same depth, speed of inference, etc).
It's one of those situations where we have reason to believe that "exactly matching" human intelligence is basically impossible: the target range is too exponentially large. You either fall short (and it's honestly odd that LLMs were able to exceed animal intelligence/judgment while still falling short of average adult humans.. even that should have been too small of a target) or you blow past it completely into something that both humans and teams of humans could never compete directly against.
Chess and Go are fine examples here: algorithms spent very short periods of time "at a level where they could compete reasonably well against" human grand masters. It was decades falling short, followed by quite suddenly leaving humans completely in the dust with no delusions of ever catching up.
That is what the large players hope to get with AGI as well (and/or failing that, using AI as a smoke screen to bilk investors and the public, cover up their misdeeds, play cup and ball games with accountability, etc)
Re: Google plans to invest up to $40B in Anthropic
#570Earlier quoted context omitted.
To be honest, I think "vendor financing" is still a very risky premise. Vendors may be positioned to know how a customer is doing, but they're also incentivized to overestimate how well a customer is going to perform. GE Capital (edit: and GMCA) is a great example of how seemingly reasonable vendor financing can cause the lender serious problems.
> To be honest, I think "vendor financing" is still a very risky premise. Are you aware that all heavy industry in all highly developed nations make extensive use of vendor financing to sell their products? Siemens is a perfect example of a well-run, stable, industrial giant. They offer vendor financing for large purchases. Same for the "heavies" (Mitsubishi, Kawasaki, IHI, Hyundai, Doosan, Hanjin) in Japan and Korea…
The OP did mention GE Capital, the motherload of all heavy industry vendor financing. And of massaging the accounting books in order to increase shareholder value in the short term, also.