They certainly need the money, not sure how many users will pay for monthly subscription.
Amazon to invest another $4B in Anthropic
141–150 of 383 posts
Re: Amazon to invest another $4B in Anthropic
#142Earlier quoted context omitted.
Hmmm... I wonder if this is why some of the results I've gotten over the past few days have been pretty bad. It's easy to dismiss poor results on LLM quality variance from prompt to prompt vs. something like this where the quality is actively degraded without notification. I can't say this is in fact what I'm experience, but it was noticeable enough I'm going to check.
This is one reason closed models suck. You can't tell if the bad responses are due to something you are doing, or if the company you are paying to generate the responses is cutting corners and looking for efficiencies, eg by reducing the number of bits. It is a black box.
To be fair even if you did know it would still behave the same way.
Re: Amazon to invest another $4B in Anthropic
#143> Amazon does not have a seat on Anthropic’s board.
Insane
Re: Amazon to invest another $4B in Anthropic
#144Earlier quoted context omitted.
I am a paying customer with credits and the API endpoints rate-limited me to the point where it's actually unusable as a coding assistant. I use a VS Code extension and it just bailed out in the middle of a migration. I had to revert everything it changed and that was not a pleasant experience, sadly.
Control your own inference endpoints.
Could you explain more on how to do this? e.g if I am using the Claude API in my service, how would you suggest I go about setting up and controlling my own inference endpoint?
Re: Amazon to invest another $4B in Anthropic
#145Earlier quoted context omitted.
Yes but Amazon is not making extra money with you being their biggest customer With Anthropic yes
Anthropic is getting $4B in investment in a year where their revenue was about $850M. Even if Amazon had bought them outright for that much, they would not be ahead. The fact that everybody keeps repeating the claim that Amazon is "making money" makes this appear like some kind of scam.
[deleted]
Re: Amazon to invest another $4B in Anthropic
#146Anthropic will be the winner here, zero doubts in my mind. They have leapfrogged head and shoulders above OpenAI over the last year. Who'd have thought a business predicated entirely on keeping the ~1000 people on earth qualified to work on this stuff happy would go downhill once they failed at that.
Re: Amazon to invest another $4B in Anthropic
#147Earlier quoted context omitted.
Control your own inference endpoints.
Could you explain more on how to do this? e.g if I am using the Claude API in my service, how would you suggest I go about setting up and controlling my own inference endpoint?
You can't. He means by using the open source models.
Re: Amazon to invest another $4B in Anthropic
#148They certainly need the money. The Pro service has been running in limited mode all week due to being over capacity. It defaults to “concise” mode during high capacity but Pro users can select to put it back into “Full Response.” But I can tell the quality drops even when you do that, and it fails and brings up error messages more commonly. They don’t have enough compute to go around.
I am a paying customer with credits and the API endpoints rate-limited me to the point where it's actually unusable as a coding assistant. I use a VS Code extension and it just bailed out in the middle of a migration. I had to revert everything it changed and that was not a pleasant experience, sadly.
Why not just continue the migration manually?
Re: Amazon to invest another $4B in Anthropic
#149Earlier quoted context omitted.
Google Cloud revenue up 35% thanks to AI products [1,4,5]. Azure sales by a similar amount (but only 12% was AI products [2]. AWS is up too [3]. In so glad your point was that it’s not a scam, and there are billions of dollars in real sales occurring at a variety of companies. It’s amazing what publicly traded companies disclose if we only bother to read it. I’m glad we’re all not in the contrarian bubble where we ha…
> In so glad your point was that it’s not a scam Except it sort of is. It needs AI to be hyped and propped up, so that all those silly companies spending in GCP can continue to do so for a wee bit longer.
I don’t know if that makes it a scam.
I think you’re putting the cart before the horse.
Big cloud providers will push anything that would make them money. That’s just what marketing is.
AI was exciting long before big cloud providers even existed. Once it was clear that a product could be made, they started marketing it and selling the compute needed.
What’s the scam?
Re: Amazon to invest another $4B in Anthropic
#150Earlier quoted context omitted.
I also don't understand the idea of voice mode, or agent controller computer. Maybe it is cool to see as a tech demo, but all I really want is good quality, at reasonable price for the LLM service
I think voice mode makes significantly more sense when you consider people commuting by car by themselves every day. Personally I don't (and I'd never talk to an LLM on public transit or in the office), but almost every time I do drive somewhere, I find myself wishing for a smarter voice-controlled assistant that would allow me to achieve some goal or just look up some trivia without ever having to look at a screen (…
this is noble reasoning: using cell phone while driving is a bad idea, high five!
but isn't voice mode a reminiscence of the "faster horses"?