Claude 3.7 Sonnet and Claude Code

Post by cmdtab » Mon, Feb 24, 2025, 8:47 PM UTC

punkpeye wrote: post #212

pookieinc wrote: post #108

Earlier quoted context omitted.

The biggest complaint I (and several others) have is that we continuously hit the limit via the UI after even just a few intensive queries. Of course, we can use the console API, but then we lose ability to have things like Projects, etc. Do you foresee these limitations increasing anytime soon? Quick Edit: Just wanted to also say thank you for all your hard work, Claude has been phenomenal.

If you are open to alternatives, try https://glama.ai/gateway We currently serve ~10bn tokens per day (across all models). OpenAI compatible API. No rate limits. Built in logging and tracing. I work with LLMs every day, so I am always on top of adding models. 3.7 is also already available. https://glama.ai/models/claude-3-7-sonnet-20250219 The gateway is integrated directly into our chat ( https://glama.ai/chat ). So…

Post by Kerrick » Mon, Feb 24, 2025, 8:48 PM UTC

catherinewu wrote: post #312

LouisSayers wrote: post #277

Earlier quoted context omitted.

Could you tell us a bit about the coding tools you use and how you go about interacting with Claude?

We find that Claude is really good at test driven development, so we often ask Claude to write tests first and then ask Claude to iterate against the tests

Post by Squarex » Mon, Feb 24, 2025, 8:51 PM UTC

freediver wrote: post #251

Kagi LLM benchmark updated with general purpose and thinking mode for Sonnet 3.7. https://help.kagi.com/kagi/ai/llm-benchmark.html Appears to be second most capable general purpose LLM we tried (second to gemini 2.0 pro, in front of gpt-4o). Less impressive in thinking mode, about at the same level as o1-mini and o3-mini (with 8192 token thinking budget). Overall a very nice update, you get higher quality and higher…

Post by bearjaws » Mon, Feb 24, 2025, 8:55 PM UTC

anotherpaulg wrote: post #331

Claude 3.7 Sonnet scored 60.4% on the aider polyglot leaderboard [0], WITHOUT USING THINKING. Tied for 3rd place with o3-mini-high. Sonnet 3.7 has the highest non-thinking score, taking that title from Sonnet 3.5. Aider 0.75.0 is out with support for 3.7 Sonnet [1]. Thinking support and thinking benchmark results coming soon. [0] https://aider.chat/docs/leaderboards/ [1] https://aider.chat/HISTORY.html#aider-v0750

Post by sa46 » Mon, Feb 24, 2025, 8:56 PM UTC

LinXitoW wrote: post #283

hubraumhugo wrote: post #131

You can get your HN profile analyzed by it and it's pretty funny :) https://hn-wrapped.kadoa.com/ I'm using this to test the humor of new models.

Got absolutely read to filth: > You've spent more time explaining why Go's error handling is bad than Go developers have spent actually handling errors. > Your relationship with programming languages is like a dating show - you keep finding flaws in all of them but can't commit to just one. > If error handling were a religion, you'd be its most zealous missionary, converting the unchecked one exception at a time.