Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Amazon to invest another $4B in Anthropic

cnbc.com

Post reply on HN
Print view View original

241–250 of 383 posts

Re: Amazon to invest another $4B in Anthropic

#241

Post by pdpi »

hirvi74 wrote: post #222
TimTheTinker wrote: post #209

Earlier quoted context omitted.

Claude also more readily corrects me or answers "no" to a question (when the answer should be "no").

So, I have a custom prompt I use with GPT that I found here a year or so ago. One of the custom prompt instructions was something along the lines of being more direct when it does not know something. Since then, I have not had that problem, and have even managed to get just "no" or "I don't know" as an answer.

At this rate, we're going to have "LLM psychology" courses at some point in the near future.

Re: Amazon to invest another $4B in Anthropic

#242

Post by staticman2 »

flkiwi wrote: post #236
TimTheTinker wrote: post #209

Earlier quoted context omitted.

Claude also more readily corrects me or answers "no" to a question (when the answer should be "no").

I'm not sure which part in the chain is responsible, but the Kagi Assistant got extremely testy with me when (a) I was using Claude for its engine (hold that thought) and (b) I asked the Assistant how much it changed its approach when I changed to ChatGPT, etc. (Kagi Assistant can access different models, but I have no idea how it works.) The Assistant insisted, indignantly, that it was completely separate from Claud…

The model likely sees something like this:

~~

User: Hello!

Assistant: Hi there how can I help you?

User: I just changed your model how do you feel?

~~

In other words it has no idea that you changed models. There's no meta data telling it this.

That said Poe handles it differently and tells the model when another model said something, but oddly enough doesn't tell the current model what it's name is. On Poe when you switch models the AI sees this:

~~

Aside from you and me, there is another person: Claude-3.5-Sonnet. I said, "Hello!"

Claude-3.5-Sonnett said, "Hi there how can I help you?? "

I said, "I just changed your model how do you feel?"

You are not Claude-3.5-Sonnett. You are not I.

~~

Re: Amazon to invest another $4B in Anthropic

#243

Post by crowcroft »

sangnoir wrote: post #187
crowcroft wrote: post #166

So we have Microsoft -> OpenAI (& Inflection AI) Google -> Gemini (and a bit of Anthropic) Amazon -> Anthropic Meta -> Llama Is big tech good for the startup ecosystem, or are they monopolies eating everything (or both?). To be fair to Google and Meta they came up with a lot of the stuff in the first place, and aren't just buying the competition.

There wouldn't be an LLM startup ecosystem without big tech. Notable contributions: Nvidia for, well, (gestures at everything), Google for discovering (inventing?) transformers, being early advocates of ML, authoring tensorflow, Meta for Torch and open sourcing Llama, Microsoft for investing billions in OpenAI early on and keeping the hype alive. The last one is a reach, I'm sure Microsoft Research did some cool thin…

You might be right, we don’t know how an alternative reality would have played out though to say if this is the only way (and fastest) way we could have got here.

Re: Amazon to invest another $4B in Anthropic

#244

Post by handfuloflight »

pdpi wrote: post #241
hirvi74 wrote: post #222

Earlier quoted context omitted.

So, I have a custom prompt I use with GPT that I found here a year or so ago. One of the custom prompt instructions was something along the lines of being more direct when it does not know something. Since then, I have not had that problem, and have even managed to get just "no" or "I don't know" as an answer.

At this rate, we're going to have "LLM psychology" courses at some point in the near future.

Turns out it's just human psychology sans embodied concerns: metabolic, hormonal, emotional, socioeconomic, sociopolitical or anything to do with self-actualization.

Re: Amazon to invest another $4B in Anthropic

#245

Post by dgfitz »

pdpi wrote: post #241
hirvi74 wrote: post #222

Earlier quoted context omitted.

So, I have a custom prompt I use with GPT that I found here a year or so ago. One of the custom prompt instructions was something along the lines of being more direct when it does not know something. Since then, I have not had that problem, and have even managed to get just "no" or "I don't know" as an answer.

At this rate, we're going to have "LLM psychology" courses at some point in the near future.

It’s like trying to reason with your 5-year-old child, except they’re not real.

Re: Amazon to invest another $4B in Anthropic

#247

Post by dimitri-vs »

cruffle_duffle wrote: post #216
therein wrote: post #211

Earlier quoted context omitted.

Oh you are asking for a 2 line change? Here is the whole file we have been working on with a preamble and closing remarks, enjoy checking to see if I actually made the change I am referring to in my closing remarks and my condolences if our files have diverged.

You know the craziest thing I’ve seen ChatGPT do is claim to have made a change to my terraform code acting all “ohh here is some changes to reflect all the things you commented on” and all it did was change the comments. It’s very bizarre when it rewrites the exact same code a second or third time and for some reason decides to change the comments. The comments will have the same meaning but will be slightly differe…

Probably an overcorrection from when people were complaining very vocally about ChatGPT being "lazy" and not providing all the code. FWIW I've seen Claude do the same thing when asked do debug something it obviously did not know how to fix it would just repeatedly refactor the same sections of code and making changes to comments.

Re: Amazon to invest another $4B in Anthropic

#250

Post by AlexAndScripts »

jmathai wrote: post #94
cainxinth wrote: post #54

They certainly need the money. The Pro service has been running in limited mode all week due to being over capacity. It defaults to “concise” mode during high capacity but Pro users can select to put it back into “Full Response.” But I can tell the quality drops even when you do that, and it fails and brings up error messages more commonly. They don’t have enough compute to go around.

I’ve been using the API for a few weeks and routinely get 529 overloaded messages. I wasn’t sure if that’s always been the case but it certainly makes it unsuitable for production workloads because it will last hours at a time. Hopefully they can add the capacity needed because it’s a lot better than GPT-4o for my intended use case.

Amazon Bedrock supports Claude 3.5, and you can use inference profiles to split it across multiple regions. It's also the same price.

For my use case I use a hybrid of the two, simulating standard rate limits and doing backoff on 529s. It's pretty reliable that way.

Just beware that the European AWS regions have been overloaded for about a month. I had to switch to the American ones.

Post reply on HN