Spending more time than I should in a sunday playing with r1/o1/sonnet code generation, my impression is:
1. Sonnet is still the best model for me. It does less mistakes than o1 and r1 and one can ask it to make a plan and think about the request before writing code. I am not sure if the whole "reasoning/thinking" process of o1/r1 is as much of an advantage as it is supposed to be. And even if sonnet does mistakes too, iterations with sonnet are faster than with o1/r1 at least.
2. r1 is good (better than previous deepseek models imo and especially better at following instructions which was my problem with deepseek models so far). The smaller models are very interesting. But the thought process often turns to overcomplicate things and it thinks more than imo it should. I am not sure that all the thinking always helps to build a better context for writing the code, which is what the thinking is actually for if we want to be honest.
3. My main problem with deepseek is that the thinking blocks are huge and it is running out of context (I think? Or just kagi's provider is unstable?) after a few iterations. Maybe if the thinking blocks from previous answers where not used for computing new answers it would help. Not sure what o1 does for this, i doubt the previous thinking carries on in the context.
4. o1 seems around the same level as r1 imo if r1 does nothing weird, but r1 does more weird things (though I use it through github copilot and it does not give me the thinking blocks). I am pretty sure one can find something that o1 performs better and one that r1 performs better. It does not mean anything to me.
Maybe other uses have different results than code generation. Maybe web/js code generation would also give different results than mine. But I do not see something to really impress me in what I actually need these tools for (more than the current SOTA baseline that is sonnet).
I would like to play more with the r1 distilations locally though, and in general I would probably try to handle the thinking blocks context differently. Or maybe use aider with the dual model approach where an r1/sonnet combo seems to give great results. I think there is potential, but not just as such.
In general I do not understand the whole "panicking" thing. I do not think anybody panics over r1, it is very good but nothing more exceptional than what we have not seen so far, except if they thought that only american companies could produce SOTA-level models which was wrong already (previous deepseek and qwen models were already at similar levels). If anything, openai's and anthropic's models are more polished. It sounds a bit sensational to me, but then again who knows, I do not trust the grounding to reality that AI companies have, so they may be panicking indeed.