Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude 3.7 Sonnet and Claude Code

anthropic.com

Post reply on HN
Print view View original

441–450 of 1001 posts

Re: Claude 3.7 Sonnet and Claude Code

#441

Post by fragmede »

bcherny wrote: post #91

Hi everyone! Boris from the Claude Code team here. @eschluntz, @catherinewu, @wolffiex, @bdr and I will be around for the next hour or so and we'll do our best to answer your questions about the product.

Now that the world's gotten used to the existence of AI, any hope on removing the guardrails on Claude? I don't need it to answer "How do I make meth", but I would like to not have to social engineer my prompts. I'd like it to just write the code I asked for and not judge me on how ethical the code might be.

Eg Claude will refuse to write code to wget a website and parse the html if you ask it to scrape your ex girlfriend's Instagram profile, for ethical and tos reasons, but if you phrase the request differently, it'll happily go off and generate code that does that exact thing.

Asking it to scrape my ex girlfriend's Instagram profile is just a stand in for other times I've hit a problem where I've had to social engineer my way past those guard rails, but does having those guard rails really provide value on a professional level?

Re: Claude 3.7 Sonnet and Claude Code

#442

Post by Etheryte »

keithwhor wrote: post #248
fsndz wrote: post #229

Earlier quoted context omitted.

if Claude Code offers a better experience, users will rapidly move from cursor to Claude Code. Claude is for Code: https://medium.com/thoughts-on-machine-learning/claude-is-fo...

(1) That's a big if. It requires building a team specialized in delivering what Cursor has already delivered which is no small task. There are probably only a handful of engineers on the planet that have or can be incentivized to develop the product intuition the Cursor founders have developed in the market already. And even then; I'm an aspiring engineer / PM at Anthropic. Why would I choose to spend all of my creat…

In my opinion you're vastly overestimating how much of a moat Cursor has. In broad strokes, in builds an index of your repo for easier referencing and then adds some handy UI hooks so you can talk to the model, there really isn't that much more going on. Yes, the autocomplete is nice at times, but it's at best like pair programming with a new hire. Every big player in the AI space could replicate what they've done, it's only a matter of whether they consider it worth the investment or not given how fast the whole field is moving.

Re: Claude 3.7 Sonnet and Claude Code

#443

Post by Copenjin »

Very good, Code is extremely nice but as others have said, if you let it go on its own it burns through your money pretty fast.

I've made it build a web scraper from scratch, figuring out the "API" of a website using a project from github in another language to get some hints, and while in the end everything was working, I've seen 100k+ tokens being sent too frequently for apparently simple requests, something feels off, it feels like there are quite a few opportunities to reduce token usage.

Re: Claude 3.7 Sonnet and Claude Code

#444

Post by raminf »

hubraumhugo wrote: post #131

You can get your HN profile analyzed by it and it's pretty funny :) https://hn-wrapped.kadoa.com/ I'm using this to test the humor of new models.

> Hacker News

> You'll finally stop checking egg prices at Costco and instead focus on writing that definitive 'How I Built My Own Super App Without Getting Rejected By Apple' post.

On it!

Re: Claude 3.7 Sonnet and Claude Code

#445

Post by taosx »

The model is expensive, it almost reaches what I charge per hour. If used right it can be a productivity increase otherwise if you trust it, it WILL introduce silent bugs. So if I have to go over the code line by line I'd prefer to use the cheapest viable model: deepseek, gemini any other free self-hosted models.

Congratz to the team!

Re: Claude 3.7 Sonnet and Claude Code

#446

Post by vbezhenar »

So far only o1 pro was breathtaking for me few times.

I wrote a kind of complex code for MCU which deals with FRAM and few buffers, juggling bytes around in a complex fashion.

I was very not sure in this code, so I spent some time with AI chats asking them to review this code.

4o, o3-mini and claude were more or less useless. They spot basic stuff like this code might be problematic for multi-thread environment, those are obvious things and not even true.

o1 pro did something on another level. It recognized that my code uses SPI to talk to FRAM chip. It decoded commands that I've used. It understood the whole timeline of using CS pin. And it highlighted to me, that I used WREN command in a wrong way, that I must have separated it from WRITE command.

That was truly breathtaking moment for me. It easily saved me days of debugging, that's for sure.

I asked the same question to Claude 3.7 thinking mode and it still wasn't that useful.

It's not the only occasion. Few weeks before o1 pro delivered me the solution to a problem that I considered kind of hard. Basically I had issues accessing IPsec VPN configured on a host, from a docker container. I made a well thought question with all the information one might need and o1 pro crafted for me magic iptables incarnation that just solved my problem. I spent quite a bit of time working on this problem, I was close but not there yet.

I often use both ChatGPT and Claude comparing them side by side. For other models they are comparable and I can't really say what's better. But o1 pro plays above. I'll keep trying both for the upcoming days.

Re: Claude 3.7 Sonnet and Claude Code

#447

Post by akreal »

j_maffe wrote: post #413

It redid half of my BSc thesis in less than 30s :| https://claude.ai/share/ed8a0e55-633f-4056-ba70-772ab5f5a08b edit: Here's the output figure https://i.imgur.com/0c65Xfk.png edit 2: Gemini Flash 2 failed miserably https://g.co/gemini/share/10437164edd0

Could this (or something similar) be found in public access/some libraries?

Re: Claude 3.7 Sonnet and Claude Code

#448

Post by gwd »

anotherpaulg wrote: post #331

Claude 3.7 Sonnet scored 60.4% on the aider polyglot leaderboard [0], WITHOUT USING THINKING. Tied for 3rd place with o3-mini-high. Sonnet 3.7 has the highest non-thinking score, taking that title from Sonnet 3.5. Aider 0.75.0 is out with support for 3.7 Sonnet [1]. Thinking support and thinking benchmark results coming soon. [0] https://aider.chat/docs/leaderboards/ [1] https://aider.chat/HISTORY.html#aider-v0750

Interesting that the "correct diff format" score went from 99.6% with Claude 3.5 to 93.3% for Claude 3.7. My experience with using claude-code was that it consistently required several tries to get the right diff. Hopefully all that will improve as they get things ironed out.

Re: Claude 3.7 Sonnet and Claude Code

#450

Post by luke-stanley »

bcherny wrote: post #91

Hi everyone! Boris from the Claude Code team here. @eschluntz, @catherinewu, @wolffiex, @bdr and I will be around for the next hour or so and we'll do our best to answer your questions about the product.

My key got killed months ago when I tested it on a PDF, and support never got back to me so I am waiting for OpenRouter support!
Post reply on HN