Live data from Hacker News

Google plans to invest up to $40B in Anthropic

bloomberg.com

551–560 of 868 posts

Re: Google plans to invest up to $40B in Anthropic

#551
There is a lot of money in the Network of Evil.

I am still upset at these companies for driving up the RAM prices. "Free market" has evident problems - companies are way too dominating here. Average Joe suffers from this price mafia, assuming he or she needs to purchase RAM now.

Re: Google plans to invest up to $40B in Anthropic

#553

Earlier quoted context omitted.

Humans ultimately judge their output by comparison and competition. When we get to the point an AI is capable of participating on the market directly, it'll no longer make sense to proxy judgement through humans anymore.

Agreed. But also, comparison and competition between individuals is only one of the ways in which improvement happens. Consider for example that it's also possible to build something for personal consumption and iteratively improve on the design without regard for what anyone else thinks of it. Cooking comes to mind.

Right. But even that is shaped directly or indirectly by environment you live in. The way you scratch your own itch looks differently depending on what itch you have. Plus, humans are social animals, we live in groups and constantly judge each other and try to have others judge us favorably.

AI has none of that now - it only gets direct human feedback from those controlling the training (or at a second level, the harness), and that feedback is really in service of the humans at the steering wheels. Sum total of humanity, mixed in the blender, and flavored to make the trainers look good in front of their peers.

Now, if AI could interact directly and propagate that feedback to their training, or otherwise learn on-line, that changes. It's a qualitative jump. The second one is, once there's enough AIs interacting with human economy and society directly, that their influence starts to outweigh ours. At that point, they'll end up evolving their own standards and benchmarks, and then it's us who will be judged by their measure.

(I.e. if you think we have it bad now, with how we're starting to adapt our writing and coding style to make it easier for LLMs, just wait when next-gen models start participating in the economy, and we'll all be forced by the market forces to learn some weird, emergent token-efficient English/Chinese pidgin that AI-run companies prefer their suppliers to use.)

Re: Google plans to invest up to $40B in Anthropic

#554

Earlier quoted context omitted.

> What good is AI that is so good that you cannot sell API access because it would help others to build equivalently powerful AI and compete with you? Its awesome and world dominating, you just don’t sell access to that AI, you instead directly, by yourself, dominate any field that better AI provides a competitive advantage in as soon as you can afford to invest the capital to otherwise operate in that field, and you…

Yup. That doesn't really take a full-blown AGI on the path to ASI on the path to godhood - it'll take a bit better and more reliable LLM with a decent harness. That's why I've been saying that the entire software industry is now living on borrowed time. It'll continue at the mercy of SOTA LLM operators, for as long as they prefer to extract rent from everyone for access to "cognition as a service". In the meantime, a…

Don't open models and competition between frontier providers both serve as barriers here? If a frontier provider pivoted as you describe it would certainly change the landscape but they wouldn't be unassailable without developing some sort of secret sauce that gave them an extremely large advantage over everyone else. They'd need a sufficient advantage to pull out far ahead of everyone else before others had a chance to react in a meaningful way. Otherwise the competitors that absorbed all your subscriptions would stack that much more hardware and continue to challenge you.

I think meaningful change to the current equilibrium would require at absolute minimum the proprietary equivalent of the development of the transformer architecture.

Re: Google plans to invest up to $40B in Anthropic

#555

Earlier quoted context omitted.

Imagine such an AI exists. What good is AI that is so good that you cannot sell API access because it would help others to build equivalently powerful AI and compete with you? If you gatekeep, you will not make back the money you invested. If you don't gatekeep, your competitors will use your model to build competing models. I guess you can sell it to the Department of War.

> What good is AI that is so good that you cannot sell API access because it would help others to build equivalently powerful AI and compete with you? Its awesome and world dominating, you just don’t sell access to that AI, you instead directly, by yourself, dominate any field that better AI provides a competitive advantage in as soon as you can afford to invest the capital to otherwise operate in that field, and you…

It's not clear to me that one horse-sized AI allows you to outcompete 100 duck-sized AIs in use by everyone else once you factor in the non-intelligence contributions that the others with weaker AIs bring to the table.

There's a lot more to building a successful product than how smart your engineers/agents are, how many engineers/agents you have, and capital.

Google, for example, can be extremely dysfunctional at launching new products despite unimaginably vast resources. They often lack intangible elements to success, such as empathizing with your customers' needs.

If we were in a world where AI was not already widespread, then I would agree that having strong AI would be an immense competitive advantage. However, in a world where "good enough" AI is increasingly widespread, the competitive advantage of strong AI diminishes as time goes on.

Re: Google plans to invest up to $40B in Anthropic

#556
post #534

Context: a few weeks ago, Anthropic signed a deal to buy "multiple gigawatts of next-generation TPU capacity" from Google and Broadcom [1]. There have been several previous deals, too. Some people call this sort of thing a "circular deal", but perhaps a better way to think of it is as a very large-scale version of vendor financing? The simple version of vendor financing is when a vendor gives a retailer time to pay f…

So yes, but that doesn't negate the circular investment aspect, for most intents and purposes. The risk is from this structure is mostly to do with how this affects market cap. Companies using the value of their shares to fund demand for their services. That's a risk.

I feel like the whole market at this point is just AI since big tech other than Apple are all massively invested into that. Everyone owns either the S&P or the total world ETF which are both heavily skewed towards big tech and this trade - so literally everybody is in it. It might go well for a few more quarters/years but once something breaks or gets exponentially cheaper this will take down the whole market with it.

Re: Google plans to invest up to $40B in Anthropic

#557
post #215

If you added up all the major AI valuations, it's apparently worth more than products Americans constantly buy and rely on for their main life. So either AI is going to be involved in every Americans life to a large degree, and paying real money for, or these valuations are insanely wrong.

there are plenty of people who basically believe this is the end of the human economy - there will be nothing left that isn't done by AI in the future. Even the bits left that humans do will be human facades on AI driven activity (like your hairdresser will be viewing you through AI powered glasses using AI powered scissors etc). So from that point of view you can indeed look at it as the entire value of the economy…

But let's be real, the AI output today is largely complete and utter shit. Like, really, without careful promoting and oversight, it's not fun to read, it's not smart, it's not accurate, it's not thorough, and it's certainly not yet over the massive show stopping hurdle that is lying and hallucinating all the time.

Re: Google plans to invest up to $40B in Anthropic

#558
post #400

Earlier quoted context omitted.

I think the opposite. AI will get cheaper as models become more efficient and we solve the datacenter/energy problem. I bet 10 years from now AI, that is way better than what we have today, will be close to free.

Just like how cloud costs got cheaper and we solved the datacenter/energy problem over the past 10 years.

Cloud did get cheaper. What are you saying?

I just ran a quick gpt check - EC2 Prices have gone down by more than 80% after accounting for performance and inflation over last 20 years.

Re: Google plans to invest up to $40B in Anthropic

#559
post #215

Earlier quoted context omitted.

there are plenty of people who basically believe this is the end of the human economy - there will be nothing left that isn't done by AI in the future. Even the bits left that humans do will be human facades on AI driven activity (like your hairdresser will be viewing you through AI powered glasses using AI powered scissors etc). So from that point of view you can indeed look at it as the entire value of the economy…

But let's be real, the AI output today is largely complete and utter shit. Like, really, without careful promoting and oversight, it's not fun to read, it's not smart, it's not accurate, it's not thorough, and it's certainly not yet over the massive show stopping hurdle that is lying and hallucinating all the time.

The more I use them the more I draw this conclusion. Like we have given certain models an unbelievable amount of slack for bad output.

Re: Google plans to invest up to $40B in Anthropic

#560
post #307

Earlier quoted context omitted.

To be honest, I think "vendor financing" is still a very risky premise. Vendors may be positioned to know how a customer is doing, but they're also incentivized to overestimate how well a customer is going to perform. GE Capital (edit: and GMCA) is a great example of how seemingly reasonable vendor financing can cause the lender serious problems.

> To be honest, I think "vendor financing" is still a very risky premise. Are you aware that all heavy industry in all highly developed nations make extensive use of vendor financing to sell their products? Siemens is a perfect example of a well-run, stable, industrial giant. They offer vendor financing for large purchases. Same for the "heavies" (Mitsubishi, Kawasaki, IHI, Hyundai, Doosan, Hanjin) in Japan and Korea…

Are we replacing "Let me google that for you" with "Here is a prompt to feed ChatGPT" now?

Edit: I am not asking whether ChatGPT is better than Google Search, I am asking after the standard dodge of citing one's sources.

Post reply on HN