Live data from Hacker News

Claude 3.5 Sonnet

anthropic.com

231–240 of 287 posts

Re: Claude 3.5 Sonnet

#231
post #216

Earlier quoted context omitted.

People really, really , underestimate how important prompting is. I would be confident in stating that half the people who complain about a model are actually just suffering from poor prompting.

are non-snake oil prompting techniques described anywhere?

Those are hard to come by, but the Anthropic prompting documentation is a pretty great source: https://docs.anthropic.com/en/docs/build-with-claude/prompt-...

Re: Claude 3.5 Sonnet

#232

Opus remained better than GPT for me, even after the release of GPT-4o. VERY happy to see an even further improvement beyond that, Claude is a terrific product and given the news that GPT-5 only began its training several weeks ago I don't see any situation where Anthropic is dethroned in the near term. There are only two parts of Anthropic's offering I'm not a fan of: - Lack of conversation sharing: I had a conversa…

If you have an API key, using Opus with a 3rd party UI like typingmind.com solves all of the problems you mentioned (disclaimer: I'm the app developer)

Re: Claude 3.5 Sonnet

#233

Using this is the first time since GPT-4 where I've been shocked at how good a model is. It's helped by how smooth the 'artifact' UI is for iterating on html pages, but I've been instructing it to make a simple web app one bit of functionality at a time and it's basically perfect (and even quite fast). I'm sure it will be like GPT-4 and the honeymoon period will wear off to reveal big flaws but honestly I'd take this…

I'd still prefer to have an intern.

However, it's because I'd empower the intern to use Claude or GPT to be even more productive.

Re: Claude 3.5 Sonnet

#234

Earlier quoted context omitted.

Sam said on Lex's podcast that people should temper their expectations for GPT-5, not in that it will necessarily suck, but that they want to ramp up ability slowly over time rather than discrete large steps.

Sounds like an excuse tbh. Esp when other companies are pushing ahead beyond OAI and open source is close to rivaling them

Yeah. Sam wants to productize $$$ what they have now rather than sink time and money training future models with uncertain outcomes. I suspect that difference in focus is what Ilya Sutskever means by wanting to “advance capabilities as fast as possible” in the in Safe Superintelligence Inc. announcement.

Re: Claude 3.5 Sonnet

#235

Opus remained better than GPT for me, even after the release of GPT-4o. VERY happy to see an even further improvement beyond that, Claude is a terrific product and given the news that GPT-5 only began its training several weeks ago I don't see any situation where Anthropic is dethroned in the near term. There are only two parts of Anthropic's offering I'm not a fan of: - Lack of conversation sharing: I had a conversa…

If you have an API key, using Opus with a 3rd party UI like typingmind.com solves all of the problems you mentioned (disclaimer: I'm the app developer)

I use LibreChat for this as self hosted UI. Works awesome.

Re: Claude 3.5 Sonnet

#236

For anyone paying and using Claude Pro, what are the message limits like compared to ChatGPT Plus? I tried one question that gave me a good answer, and then I tried two of the sample questions. After a couple more short input/outputs I reaced the max messge limit. They state that Pro is at least 5x, but if that is only ~25 short token input/outputs then that's too little for it to not be really annoying to use. What…

I feel like I hit my limit a bit sooner than I would have liked. But it's only day one, so I hope this improves over time.

Re: Claude 3.5 Sonnet

#237
post #3

Anthropic has been killing it. I subscribe to both chatgpt pro and claude, but I spend probably 90% of my time using Claude. I usually only go back to open ai when I want another model to evaluate or modify the results.

Same here. I said this somewhere else already, but honestly GPT4o feels worse than 4 to me. So that's what drove me over to using Claude more which lead to me discovering it is generally superior for most of my use cases.

Re: Claude 3.5 Sonnet

#238

Earlier quoted context omitted.

Thanks for the resource! I've seen some of them and the main issue I had is I don't want to self host anything, and I want to use latest third party models as soon as they are released. Maybe something like what I'm talking about exists already, but I think I'll still try and make my own open source version to fulfill my personal requirements.

We (disclosure: founder) do something similar at Trelent[1] but with an emphasis on security. Paid accounts can use OpenAI & Anthropic models, free ones just OpenAI. We have 3.5 sonnet live already. If you want to try it out lmk! Also totally respect building your own open-source :) [1]: https://trelent.com

wow Trelent looks cool, how does ZDR negotiation work exactly? What do you offer to the provider that allows you ZDR?

Re: Claude 3.5 Sonnet

#239
post #230

Earlier quoted context omitted.

And what makes you so confident that all those people are using different prompt styles when comparing models? You think most people don’t even understand the bare basics of how to compare two products?

That's the point: maybe someone has a personal prompting style that works great with Claude but gives worse results with GPT-4. They might complain that GPT-4 is rubbish in comparison to Claude, but someone with a different personal prompting style might experience the opposite.

Ah, I see. I’d be interested to see a study on that. I find it hard to believe it would make such a stark difference but it’s possible.

Re: Claude 3.5 Sonnet

#240
post #164

Earlier quoted context omitted.

Both GPT-4 and 4o have been completely useless for coding in the past couple of weeks for me - constant errors, and not just your typical LLM inaccuracies but incapable of producing a few lines of self-consistent code e.g. defines variables foo on one line and refers to it as bar on the next, or it misspells it as foox.

It's the same model though. Maybe your perception has changed.

Is it the same? On the Models page of the API docs it says that GPT-4 is using the June 13th which would be different than the March 23rd.
Post reply on HN