Amazon to invest another $4B in Anthropic

Post by diggan » Sat, Nov 23, 2024, 2:41 PM UTC

fny wrote: post #347

tyre wrote: post #9

Earlier quoted context omitted.

Yes exactly. This was the brilliance of the original MSFT investment into OpenAI. It was an investment in Azure scaling its AI training infra, but roundabout through a massive customer (exactly what you’d want as a design partner) and getting equity. I’m sure Anthropic negotiated a great deal on their largest cost center, while Amazon gets a huge customer to build out their system with.

And Amazon can always build their own LLM product down the line. Building out data centers feels like a far more difficult problem.

Post by bittermandel » Sat, Nov 23, 2024, 3:02 PM UTC

fny wrote: post #347

tyre wrote: post #9

Earlier quoted context omitted.

Yes exactly. This was the brilliance of the original MSFT investment into OpenAI. It was an investment in Azure scaling its AI training infra, but roundabout through a massive customer (exactly what you’d want as a design partner) and getting equity. I’m sure Anthropic negotiated a great deal on their largest cost center, while Amazon gets a huge customer to build out their system with.

And Amazon can always build their own LLM product down the line. Building out data centers feels like a far more difficult problem.

Post by greenie_beans » Sat, Nov 23, 2024, 3:30 PM UTC

greenie_beans wrote: post #233

modriano wrote: post #190

Earlier quoted context omitted.

I just start new chats whenever the chat gets long (in terms of number of tokens). It's kind of a pain to have to form a prompt that encapsulates enough context, but it has prevented me from hitting the Pro limit. Also, I include more questions and detail in each prompt. Why does that work? Claude includes the entire chat with each new prompt you submit [0], and the limit is based on the number of tokens you've submi…

> It's kind of a pain to have to form a prompt that encapsulates enough context, but it has prevented me from hitting the Pro limit. Also, I include more questions and detail in each prompt. i get it to provide a prompt to start the new chat. i sometimes wish there was a button for it bc it's such a big part of my workflow

Post by axpy906 » Sat, Nov 23, 2024, 4:05 PM UTC

AgentOrange1234 wrote: post #277

throwup238 wrote: post #156

Earlier quoted context omitted.

Last I checked, AWS reserve pricing for one year of an 8x H100 pod costs more than just buying the pod yourself (with tens of thousands left over per server for the NVIDIA enterprise license and to hire people to manage them). On demand pricing is even worse. This is essentially money that they would have spent to build out their cloud anyway, except now they also get equity in Anthropic. Whether or not Anthropic sur…

Yes and it’s also interesting that they mention using Trainium to do the training. I don’t know how much spend that is, but it seems really interesting. Like, if you’re AWS, and you imagine competing in the long run with NVIDIA for AI chips, you need to fund all that silicon development.

Post by RamblingCTO » Sat, Nov 23, 2024, 7:47 PM UTC

dymk wrote: post #201

999900000999 wrote: post #108

Earlier quoted context omitted.

Normal people aren't paying for LLMs. If they ever do Apple and Google will offer it as a service built into your phone . For example, you could say ok Google call that restaurant me and My girlfriend had our first date at 5 years ago, set up something nice so I can propose. And I guess Google Gemini ( or whatever it's called at this point), Will hire a band, some photographers, and maybe even a therapist just in cas…

But why hire a therapist when Gemini is there to talk to? Re: Github Copilot: IME it's already behind. I finally gave Cursor a try after seeing it brought up so often, and its suggestions and refactors are leagues ahead of what Copilot can do.