I prefer o1. I mostly use it as a knowledge system. Don't really care for the automatic code generation nonsense. Unless I'm really tired and the task is very simple, in which case I might decide to write a paragraph of text instead of 30 lines of Python. My experience is that when ChatGPT fails, Claude fails too. On some advanced coding tasks, I find ChatGPT's depth of reasoning ability to be better.
Ask HN: Claude 3.5 Sonnet vs. o1 vs. for coding. Let's talk!
11–20 of 21 posts
Re: Ask HN: Claude 3.5 Sonnet vs. o1 vs. <other> for coding. Let's talk!
#12Re: Ask HN: Claude 3.5 Sonnet vs. o1 vs. <other> for coding. Let's talk!
#13o1: - better for when the response has to address many subgoals coherently - usually will not undo previous bugfix progress that was made earlier in the conversation, whereas with Claude if you start having extremely long conversations I have noticed it allowing certain bugs it had already fixed to be reintroduced at much later times Claude: - image inputs are actually very complementary for debugging issues, esp if…
> with Claude if you start having extremely long conversations I have noticed it allowing certain bugs it had already fixed to be reintroduced at much later times
i think this is a result of its inability to handle long contexts well?
Re: Ask HN: Claude 3.5 Sonnet vs. o1 vs. <other> for coding. Let's talk!
#14O1 for collabing on design docs, o1 for overall structure, break it into tasks per preference / sort; sonnet/o1 for executing each small tasks. O1 is higher quality, more nuanced, and has deeper understanding; the biggest downside rn is the significantly higher latency (both due to thinking, and also, continue.dev doesn't support o1 streaming currently, so you're waiting until it's all done), and higher cost. In term…
Re: Ask HN: Claude 3.5 Sonnet vs. o1 vs. <other> for coding. Let's talk!
#15I like aider with the claude-3-5-sonnet-20241022, haven’t tried it with O1, though. Also, https://aider.chat/docs/scripting.html offers some nice possibilities.
Re: Ask HN: Claude 3.5 Sonnet vs. o1 vs. <other> for coding. Let's talk!
#16I prefer o1. I mostly use it as a knowledge system. Don't really care for the automatic code generation nonsense. Unless I'm really tired and the task is very simple, in which case I might decide to write a paragraph of text instead of 30 lines of Python. My experience is that when ChatGPT fails, Claude fails too. On some advanced coding tasks, I find ChatGPT's depth of reasoning ability to be better.
Re: Ask HN: Claude 3.5 Sonnet vs. o1 vs. <other> for coding. Let's talk!
#17Started a small project to compare AI IDEs https://github.com/StephanSchmidt/ai-coding-comparison/ (no comparison there yet, just some code to play around with)
Re: Ask HN: Claude 3.5 Sonnet vs. o1 vs. <other> for coding. Let's talk!
#18o1 if you're going to write full specs and not provide any context. Sonnet 3.5 if you can provide context (e.g. with cursor) gpt-4o for UI design. Also for solving screenshots of interviews
Re: Ask HN: Claude 3.5 Sonnet vs. o1 vs. <other> for coding. Let's talk!
#19o1 is much better at finding complex needle in the haystack bugs/fixes. sonnet 3.5 better at shallow generic coding
Re: Ask HN: Claude 3.5 Sonnet vs. o1 vs. <other> for coding. Let's talk!
#20Are there any concrete benchmarks for comparing models for different types of programming tasks?