Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Amazon to invest another $4B in Anthropic

cnbc.com

Post reply on HN
Print view View original

221–230 of 383 posts

Re: Amazon to invest another $4B in Anthropic

#221

Post by a1j9o94 »

mplewis wrote: post #178
diego_sandoval wrote: post #113

Earlier quoted context omitted.

The amount of free chats you get per day is way too limiting for anyone who uses LLMs as an important tool in their day job. 20 USD a month to make me between 1.5x and 4x more productive in one of the main tasks of my job really is a bargain, considering that 20 USD is very small fraction of my salary. If I didn't pay, I'd be forced to wait, or create many accounts and constantly switch between them, or be constantly…

[flagged]

If you aren't using LLMs for most knowledge work you're probably wasting time somewhere.

Re: Amazon to invest another $4B in Anthropic

#222

Post by hirvi74 »

TimTheTinker wrote: post #209
johnisgood wrote: post #182

I much prefer Claude over ChatGPT, based on my experience using both extensively. Claude understands me significantly better and seems to "know" my intentions with much greater ease. For example, when I request the full file, it provides it without any issues or unnecessary reiterations (ChatGPT fails after me repeatedly instructing it to), often confirming my request with a brief summary beforehand, but nothing more…

Claude also more readily corrects me or answers "no" to a question (when the answer should be "no").

So, I have a custom prompt I use with GPT that I found here a year or so ago. One of the custom prompt instructions was something along the lines of being more direct when it does not know something. Since then, I have not had that problem, and have even managed to get just "no" or "I don't know" as an answer.

Re: Amazon to invest another $4B in Anthropic

#223

Post by skerit »

johnisgood wrote: post #182

I much prefer Claude over ChatGPT, based on my experience using both extensively. Claude understands me significantly better and seems to "know" my intentions with much greater ease. For example, when I request the full file, it provides it without any issues or unnecessary reiterations (ChatGPT fails after me repeatedly instructing it to), often confirming my request with a brief summary beforehand, but nothing more…

I just use the API (well, via Openrouter) together with custom frontends like Open WebUI. No rate limiting issues then, and I can super easily switch models even in an existing conversation. Though I guess I do miss a few bells & whistles from the proprietary chat interfaces.

Re: Amazon to invest another $4B in Anthropic

#224

Post by pertymcpert »

hirvi74 wrote: post #220
johnisgood wrote: post #182

I much prefer Claude over ChatGPT, based on my experience using both extensively. Claude understands me significantly better and seems to "know" my intentions with much greater ease. For example, when I request the full file, it provides it without any issues or unnecessary reiterations (ChatGPT fails after me repeatedly instructing it to), often confirming my request with a brief summary beforehand, but nothing more…

I've started to notice that GPT-* vs. Claude is quite domain (and even subdomain) specific. For programming, when using languages like C, python, ruby, C#, and JS, both seemed fairly comparable to me. However, I was astounded at how awful Claude was at Swift. Most of what I would get from Claude wouldn't even compile, contained standard library methods that did not exist, and so on. For whatever reason, GPT is night…

I wonder if OpenAI have been less strict about not training on proprietary or legally questionable code sources.

Re: Amazon to invest another $4B in Anthropic

#225

Post by hirvi74 »

rmbyrro wrote: post #159
jmathai wrote: post #94

Earlier quoted context omitted.

I’ve been using the API for a few weeks and routinely get 529 overloaded messages. I wasn’t sure if that’s always been the case but it certainly makes it unsuitable for production workloads because it will last hours at a time. Hopefully they can add the capacity needed because it’s a lot better than GPT-4o for my intended use case.

Sonnet is better than 4o for virtually all use cases. The only reason I still use OpenAI's API and chatbot service is o1-preview. o1 is like magic. Everything Sonnet and 4o do poorly, o1 solves like a piece of cake. Architecting, bug fixing, planning, refactoring, o1 has never let me know on any 'hard' task. A nice combo is have o1 guiding Sonnet. I ask o1 to come up with a solution and explanation, then simply feed…

I alluded to this in another comment, but I have 4o to be better than Sonnet in Swift, Obj-C, and Applescript. In my experiences, Claude is worse than useless with those three languages when compared to GPT. Everything else, I'd say the differences haven't been too extreme. Though, o1-preview absolutely smokes both in my experiences too, but it isn't hard for me to hit it's rate limit either.

Re: Amazon to invest another $4B in Anthropic

#227

Post by pertymcpert »

cruffle_duffle wrote: post #216
therein wrote: post #211

Earlier quoted context omitted.

Oh you are asking for a 2 line change? Here is the whole file we have been working on with a preamble and closing remarks, enjoy checking to see if I actually made the change I am referring to in my closing remarks and my condolences if our files have diverged.

You know the craziest thing I’ve seen ChatGPT do is claim to have made a change to my terraform code acting all “ohh here is some changes to reflect all the things you commented on” and all it did was change the comments. It’s very bizarre when it rewrites the exact same code a second or third time and for some reason decides to change the comments. The comments will have the same meaning but will be slightly differe…

I don't think the context window has to change for that to happen. The LLMs don't just pick the most likely next token, it's sampled from the distribution of possible tokens so on repeat runs you can get different results.

Re: Amazon to invest another $4B in Anthropic

#228

Post by rvz »

el_benhameen wrote: post #93
cainxinth wrote: post #54

They certainly need the money. The Pro service has been running in limited mode all week due to being over capacity. It defaults to “concise” mode during high capacity but Pro users can select to put it back into “Full Response.” But I can tell the quality drops even when you do that, and it fails and brings up error messages more commonly. They don’t have enough compute to go around.

Interesting. I also find it frustrating to be rate limited/have responses fail when I’m paying for the product, but I’ve actually found that the “concise” mode answers have less fluff and make for faster back and forth. I’ve once or twice looked for the concise mode selector when the load wasn’t high.

All that money and talk of "scale" and yet not only it is slow but costs billions a year to run at normal load and is struggling at high load.

This is essentially Google-level load and they can't do it.

Re: Amazon to invest another $4B in Anthropic

#229

Post by neumann »

TeMPOraL wrote: post #165
datavirtue wrote: post #152

Earlier quoted context omitted.

You aren't running against a local LLM?

That's like asking if they aren't paying the neighborhood drunk with wine bottles for doing house remodeling, instead of hiring a renovation crew.

That's what my grandma did in the village in Hungary. But with schnapps. And the drunk was also the professional renovation crew.

Re: Amazon to invest another $4B in Anthropic

#230

Post by TeMPOraL »

rybosome wrote: post #218
TeMPOraL wrote: post #165

Earlier quoted context omitted.

That's like asking if they aren't paying the neighborhood drunk with wine bottles for doing house remodeling, instead of hiring a renovation crew.

That’s funny, but open weight, local models are pretty usable depending on the task.

You're right, but that's also subject to compute costs and time value of money. The calculus is different for companies trying to exploit language models in some way, and different for individuals like me who have to feed the family before splurging for a new GPU, or setting up servers in the cloud, when I can get better value by paying OpenAI or Claude a few dollars and use their SOTA models until those dollars run out.

FWIW, I am a strong supporter of local models, and play with them often. It's just that for practical use, the models I can run locally (RTX 4070 TI) mostly suck, and the models I could run in the cloud don't seem worth the effort (and cost).

Post reply on HN