Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude 3.7 Sonnet and Claude Code

anthropic.com

Post reply on HN
Print view View original

821–830 of 1001 posts

Re: Claude 3.7 Sonnet and Claude Code

#821

Post by throw83288 »

pzo wrote: post #697
danw1979 wrote: post #470

Earlier quoted context omitted.

Serious answer: learn to code. You still need to know what good code looks like to use these tools. If you go forward in your career trusting the output of LLMs without the skills to evaluate the correctness, style, functionality of that code then you will have problems. People still write low level machine code today, despite compilers having existed for 70+ (?) years. We'll always need full-stack humans who underst…

I will give a little more pessimistic answer. If someone is right now studying CS then probably have expectation that can work with this profession for 30-40 years until retirement and this profession will still pay much more than average salary for most of devs anywhere (instead only of elite devs or those in US) and easily to find such job or easily switch employer. I think the best period of Software Devs will be…

I would love to make "side revenue", but frankly I am awful at practical idea generation. I'm not a founder type I think, maybe a technical co-founder I guess.

Re: Claude 3.7 Sonnet and Claude Code

#822

Post by throw83288 »

throw234234234 wrote: post #731
currymj wrote: post #635

Earlier quoted context omitted.

I think if you believe LLMs can truly generalize and will be able to replace all labor in entire industries and 10x every year, you pretty much should believe in ASI at which point having a job is the least of your problems. if you rule out ASI, then that means progress is going to have to slow. consider that programming has been getting more and more automated continually since 1954. so put yourself in a position wh…

I don't know if I agree with that and as a SWE myself its tempting to think that - it it a form of coping and hope that we will be all in it together. However rationally I can see where these models are evolving, and it leads me to think the software industry is on its own here at least in the short/medium term. Code and math, and with math you typically need to know enough about the domain know what abstract concept…

I think what's missing is that the amount of training data to effectively RL usually decreases over time. AlphaGo needed some initial data on good games of Go to then recursively improve via RL. Fast forward a few years, and AlphaZero doesn't need any data to recursively improve.

This is what I mean by generalization skills. You need trillions of lines of code to RL a model into a good SWE right now, but as the models grow more capable you will probably need less and less. Eventually we may hit the point where a large corporations internal data in any department is enough to RL into competence, and then it frankly doesn't matter for any field once individual conglomerates can start the flywheel.

This isn't an absurdity. Man can "RL" itself into competence in a single semester of material, a laughably small amount of training data compared to an LLM.

Re: Claude 3.7 Sonnet and Claude Code

#824

Post by coffeeaddict1 »

AlfeG wrote: post #729

Ahha, recently my daugher come to me with 3rd grade math problem. "Without rearranging the digits 1 2 3 4 5, insert mathematical operation signs and, if necessary, parentheses between them so that the resulting expression equals 40 and 80. The key is that you can combine digits (like 12+3/45) but you cannot change their order from the original sequence 1,2,3,4,5" Grok3, Claude, Deepseek, Qwen all failed to solve this…

o3-mini-high solves this correctly:

```

We can “stick‐to the order” of the digits and allow concatenation. For example, one acceptable answer is

  40:  1 – 2 × 3 + 45    because 1 – (2×3) + 45 = 1 – 6 + 45 = 40
and another is

  80:  12 ÷ 3 × 4 × 5    because 12÷3 = 4, then 4×4×5 = 16×5 = 80
In both cases the digits 1,2,3,4,5 appear in order without rearrangement.

```

However, it took 8 minutes to produce that.

Re: Claude 3.7 Sonnet and Claude Code

#825

Post by [deleted] »

anotherpaulg wrote: post #331

Claude 3.7 Sonnet scored 60.4% on the aider polyglot leaderboard [0], WITHOUT USING THINKING. Tied for 3rd place with o3-mini-high. Sonnet 3.7 has the highest non-thinking score, taking that title from Sonnet 3.5. Aider 0.75.0 is out with support for 3.7 Sonnet [1]. Thinking support and thinking benchmark results coming soon. [0] https://aider.chat/docs/leaderboards/ [1] https://aider.chat/HISTORY.html#aider-v0750

[deleted]

Re: Claude 3.7 Sonnet and Claude Code

#826

Post by frabcus »

TriangleEdge wrote: post #94

This AI race is happening so fast. Seems like it to me anyway. As a software developer/engineer I am worried about my job prospects.. time will tell. I am wondering what will happen to the west coast housing bubbles once software engineers lose their high price tags. I guess the next wave of knowledge workers will move in and take their place?

I think if models improve (but we don't get a full singularity) then jobs will increase.

e.g. if software is 5x less cost to make, demand will go up more than 5x as supply is highly limited now. Lots of companies want better software but it costs too much.

That will create more jobs.

They'll be more product management and human interaction and edge case testing and less typing. Although I think there'll be a bunch of very technical jobs to debug things when the models fail.

So my advice is learn skills that help make software useful to people and businesses - from user research to product management. As well as engineering.

Re: Claude 3.7 Sonnet and Claude Code

#829

Post by anotherpaulg »

vessenes wrote: post #700
anotherpaulg wrote: post #580

Earlier quoted context omitted.

Using up to 32k thinking tokens, Sonnet 3.7 set SOTA with a 64.9% score. 65% Sonnet 3.7, 32k thinking 64% R1+Sonnet 3.5 62% o1 high 60% Sonnet 3.7, no thinking 60% o3-mini high 57% R1 52% Sonnet 3.5

Paul, I saw in the notes that using claude with thinking mode requires yml config updates -- any pointers here? I was parsing some commits, and I couldn't tell if you only added architect support through openrouter. Thanks!

Here are the current docs for changing the thinking token limits.

https://aider.chat/docs/llms/anthropic.html#thinking-tokens

I'll make this less clunky soon.

Re: Claude 3.7 Sonnet and Claude Code

#830

Post by jamiedumont »

Copenjin wrote: post #443

Very good, Code is extremely nice but as others have said, if you let it go on its own it burns through your money pretty fast. I've made it build a web scraper from scratch, figuring out the "API" of a website using a project from github in another language to get some hints, and while in the end everything was working, I've seen 100k+ tokens being sent too frequently for apparently simple requests, something feels…

That was my sense too. Used it for a few similar programs today (like converting HTML to Markdown but parsing certain elements to shortcodes) and scaffolding a Rust web app.

It's done a reasonable job — but rips through credit, often changing its mind. Even strong-arming it into choosing an approach, it wanted to flip-flop between using regex and lol_html to parse the HTML whenever it came across a difficulty.

If you're a US developer on whatever multiple of $ to the £ that I earn it might make sense, but burning through $100p/h for a pair programmer is a bit rich for my blood.

Post reply on HN