Amazon to invest another $4B in Anthropic • Hacker News Board

Re: Amazon to invest another $4B in Anthropic

#191

Post by johnisgood » Fri, Nov 22, 2024, 9:54 PM UTC

el_benhameen wrote: post #93

cainxinth wrote: post #54

They certainly need the money. The Pro service has been running in limited mode all week due to being over capacity. It defaults to “concise” mode during high capacity but Pro users can select to put it back into “Full Response.” But I can tell the quality drops even when you do that, and it fails and brings up error messages more commonly. They don’t have enough compute to go around.

Interesting. I also find it frustrating to be rate limited/have responses fail when I’m paying for the product, but I’ve actually found that the “concise” mode answers have less fluff and make for faster back and forth. I’ve once or twice looked for the concise mode selector when the load wasn’t high.

Agreed, I was surprised by it after I first have subscribed to Pro and had a not-that-long chat with it.

Re: Amazon to invest another $4B in Anthropic

#192

Post by sunaookami » Fri, Nov 22, 2024, 9:55 PM UTC

andai wrote: post #174

I've been playing with Alibaba's Qwen 2.5 model and I've had it claim to be Claude. (Though it usually claims to be Llama, and it seems to think it's a literal llama, i.e. it identifies as an animal, "among other things".)

Claude also sometimes claims/claimed that it is ChatGPT or a model by OpenAI. Same with LLaMa. It's just polluated training data.

Re: Amazon to invest another $4B in Anthropic

#193

Post by llm_trw » Fri, Nov 22, 2024, 9:56 PM UTC

cainxinth wrote: post #54

They certainly need the money. The Pro service has been running in limited mode all week due to being over capacity. It defaults to “concise” mode during high capacity but Pro users can select to put it back into “Full Response.” But I can tell the quality drops even when you do that, and it fails and brings up error messages more commonly. They don’t have enough compute to go around.

Neither does OAI. Their service has been struggling for more than a week now. I guess everyone is scrambling after the new qwen models dropped and matched the current state of the art with open weights.

Re: Amazon to invest another $4B in Anthropic

#194

Post by shmatt » Fri, Nov 22, 2024, 10:01 PM UTC

cainxinth wrote: post #54

They certainly need the money. The Pro service has been running in limited mode all week due to being over capacity. It defaults to “concise” mode during high capacity but Pro users can select to put it back into “Full Response.” But I can tell the quality drops even when you do that, and it fails and brings up error messages more commonly. They don’t have enough compute to go around.

in the beginning i was agitated by Concise and would move it back manually. But then I actually tried it, I asked for SQL and it gave me back SQL and 1-2 sentences at most

Regular mode gives SQL and entire paragraphs before and after it. Not even helpful paragraphs, just rambling about nothing and suggesting what my next prompt should be

Now I love concise mode, it doesn't skimp on the meat, just the fluff. Now my problem is, concise only shows up during load. Right now I can't choose it even if i wanted to

Re: Amazon to invest another $4B in Anthropic

#195

Post by avarun » Fri, Nov 22, 2024, 10:01 PM UTC

cma wrote: post #179

cainxinth wrote: post #54

They certainly need the money. The Pro service has been running in limited mode all week due to being over capacity. It defaults to “concise” mode during high capacity but Pro users can select to put it back into “Full Response.” But I can tell the quality drops even when you do that, and it fails and brings up error messages more commonly. They don’t have enough compute to go around.

> But I can tell the quality drops even when you do that Dario said in a recent interview that they never switch to a lower quality model in terms of something with different parameters during times of load. But he left room for interpretation on whether that means they could still use quantization or sparsity. And then additionally, his answer wasn't clear enough to know whether or not they use a lower depth of beam…

Source?

Re: Amazon to invest another $4B in Anthropic

#196

Post by mrcwinn » Fri, Nov 22, 2024, 10:06 PM UTC

The status pages of OpenAI and Anthropic are in stark contrast and that mirrors my experience. Love Anthropic for code and its Projects feature, but OpenAI is still way ahead on voice and reliability.

Re: Amazon to invest another $4B in Anthropic

#197

Post by phillipcarter » Fri, Nov 22, 2024, 10:09 PM UTC

whatshisface wrote: post #33

raverbashing wrote: post #19

Earlier quoted context omitted.

Yes but Amazon is not making extra money with you being their biggest customer With Anthropic yes

Anthropic is getting $4B in investment in a year where their revenue was about $850M. Even if Amazon had bought them outright for that much, they would not be ahead. The fact that everybody keeps repeating the claim that Amazon is "making money" makes this appear like some kind of scam.

This is a way to keep the money printer called AWS Bedrock going and going and going. Don't underestimate the behemoth enterprises in the AWS rolodex who are all but assured to use that service for the next 5+ years at high volume.

Re: Amazon to invest another $4B in Anthropic

#198

Post by jacobsimon » Fri, Nov 22, 2024, 10:09 PM UTC

dartos wrote: post #149

surgical_fire wrote: post #139

Earlier quoted context omitted.

> In so glad your point was that it’s not a scam Except it sort of is. It needs AI to be hyped and propped up, so that all those silly companies spending in GCP can continue to do so for a wee bit longer.

I don’t know if that makes it a scam. I think you’re putting the cart before the horse. Big cloud providers will push anything that would make them money. That’s just what marketing is. AI was exciting long before big cloud providers even existed. Once it was clear that a product could be made, they started marketing it and selling the compute needed. What’s the scam?

I think the implication of the top comment is that cloud providers are buying revenue. When we say that cloud provider revenue is "up due to AI", a large part of that growth may be their own money coming back to them through these investments. Nvidia has been doing the same thing, by loaning data centers money to buy their chips. Essentially these companies are loaning each other huge sums of money and representing the resulting income as revenue rather than loan repayments.

To be clear, it's not to say that AI itself is a scam, but that the finance departments are kind of misrepresenting the revenue on their balance sheets and that may be security fraud.

Re: Amazon to invest another $4B in Anthropic

#199

Post by cruffle_duffle » Fri, Nov 22, 2024, 10:13 PM UTC

shmatt wrote: post #194

cainxinth wrote: post #54

They certainly need the money. The Pro service has been running in limited mode all week due to being over capacity. It defaults to “concise” mode during high capacity but Pro users can select to put it back into “Full Response.” But I can tell the quality drops even when you do that, and it fails and brings up error messages more commonly. They don’t have enough compute to go around.

in the beginning i was agitated by Concise and would move it back manually. But then I actually tried it, I asked for SQL and it gave me back SQL and 1-2 sentences at most Regular mode gives SQL and entire paragraphs before and after it. Not even helpful paragraphs, just rambling about nothing and suggesting what my next prompt should be Now I love concise mode, it doesn't skimp on the meat, just the fluff. Now my pr…

Totally agree. I wish there was a similar option on ChatGPT. These things are seemingly trained to absolutely love blathering on.

And all that blathering eats into their precious context window with tons of repetition and little new information.

Re: Amazon to invest another $4B in Anthropic

#200

Post by Deegy » Fri, Nov 22, 2024, 10:15 PM UTC

ToDougie wrote: post #122

rtsil wrote: post #49

Earlier quoted context omitted.

> Win the developers over and the rest will follow. Will they really? Anecdotal evidence, but nobody I know in real life knows about Claude (other than it's an ordinary first name). And they all use or at least know about ChatGPT. None of them are software engineers of course. But the corporate deciders aren't software engineers either.

I use Claude Pro paid version every day, but not for coding. I used to be a software engineer, but no longer. I tried OpenAI in the past, but I did not enjoy it. I do not like Sam Altman. My use cases: Generating a business plan, podcast content, marketing strategies, sales scripts, financial analyses, canned responses, and project plans. I also use it for general brainstorming, legal document review, and so many oth…

I also prefer Claude after trying the same options as you.

That said I can't yet confidently speak to exactly why I prefer Claude. Sometimes I do think the responses are better than any model on ChatGPT. Other times I am very impressed with chatGPT's responses. I haven't done a lot of testing on each with identical prompt sequences.

One thing I can say for certainty is that Claude's UI blows chatGPT's out of the water. Much more pleasant to use and I really like Projects and Artifacts. It might be this alone that has me biased towards Claude. It makes me think that UI and additional functionality is going to play a much larger role in determining the ultimate winner of the LLM wars than current discussions give it credit for.