Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Promising results from DeepSeek R1 for code

simonwillison.net

Post reply on HN
Print view View original

581–590 of 765 posts

Re: Promising results from DeepSeek R1 for code

#581

Post by visarga »

toth wrote: post #312
joshmarlow wrote: post #68

Earlier quoted context omitted.

> make the balance between capital and labor even more uneven. I think it's interesting to note that as opens source models evolve and proliferate, the capital required for a lot of ventures goes down - which levels the playing field. When I can talk to one agent-with-a-CAD-integration and have it design a gadget for me and ship the design off to a 3D printer and then have another agent write the code to run on the g…

I can't understand how you reach your conclusion. At present, if you have financial capital and need intellectual capital you need to find people willing to work for you and pay them a lot of money. With enough progress in AI you can get the intellectual capital from machines instead, for a lot less. What loses value is human intellectual capital. Financial capital just gained a lot of power, it can now substitute fo…

> But why wouldn't Sam Altman or whomever just start AI Ycombinator with hundreds of thousands of AI "founders"? Do you really think it would be more "democratic"?

AI is useful in the same way with Linux

- can run locally

- empowers everyone

- need to bring your own problem

- need to do some of the work yourself

The moral is you need to bring your problem to benefit. The model by itself does not generate much benefits. This means AI benefits are distributed like open source ones.

Re: Promising results from DeepSeek R1 for code

#582

Post by colonial »

terhechte wrote: post #308
mohsen1 wrote: post #10

I am subscribed to o1 Pro and am working on a little Rust crate. I asked both o1 Pro and Deepseek R1 to write e2e tests given all of the code in the repo (using yek[1]). o1 Pro code: https://github.com/bodo-run/clap-config-file/pull/3 Deepseek R1: https://github.com/bodo-run/clap-config-file/pull/4 My judgement is that Deepseek wrote better tests. This repo is small enough for making a judgement by reviewing the code…

I have a set of tests that I can run against different models implemented in different languages (e.g. the same tests in Rust, Ts, Python, Swift), and out of these languages, all models have by far the most difficulty with Rust. The scores are notably higher for the same tests in other languages. I'm currently preparing the whole thing for release to share, but its not ready yet because some urgent work-work came up.

Can confirm anecdotally. Even R1 (the full, official version with web search enabled) crashes out hard on my personal Rust benchmark - it refers to multiple items (methods, constants) that don't exist and fails to import basic necessary traits like io::Read. Embarrassing, and does little to challenge my belief that these models will never reliably advance beyond boilerplate.

(My particular test is to ask for an ICMP BPF that does some simple constant comparisons. Correctly implemented, this only takes 6 sock_filters.)

Re: Promising results from DeepSeek R1 for code

#583

Post by kragen »

kragen wrote: post #472
lukan wrote: post #469

Earlier quoted context omitted.

Do you mean mainly deepseek, or did I missed something big?

Mainly DeepSeek, but also the fallout: a trillion-dollar drop in US stock markets, the new vaporware Qwen that beats DeepSeek, the apparent discrediting of US export controls, OpenAI Operator, etc.

Oh, and apparently Kimi k1.5 and the supposedly-half-trillion-dollar "Stargate" announcement.

Re: Promising results from DeepSeek R1 for code

#584

Post by throwu2728828 »

simonw wrote: post #489
throwu2728828 wrote: post #460

Earlier quoted context omitted.

I really want this to be true, but honestly it's really hard. What makes you think this won't be eaten too within the next year based on the current s-curve-if-not-exponential we are on?

I still don't believe in AGI.

Why? It feels like the spade of advancements post-o1 are shattering all remaining roadblocks to AGI.

Re: Promising results from DeepSeek R1 for code

#585

Post by colonial »

catigula wrote: post #397

Dario Amodei says software engineering is fully automated by 2027. You might have the 0.01% engineer left over, but that's it, the job is finished. I think people need to start considering strongly what kind of career they can re-skill to. https://darioamodei.com/machines-of-loving-grace

Dario is the CEO of Anthropic. I'm struggling to imagine a more blatant case of motivated reasoning.

Re: Promising results from DeepSeek R1 for code

#586

Post by ghxst »

ghxst wrote: post #381
bbzealot wrote: post #42

Earlier quoted context omitted.

Why though? I'm worried these technologies may take my job away and make the balance between capital and labor even more uneven. Why should I be happy?

> I'm worried these technologies may take my job away The way I look at this is that with the release of something like deepseek the possibility of running a model offline and locally to work _for_ you while you are sleeping, doing groceries, spending time with your kids / family is coming closer to a reality. If AI is able to replace me one day I'll be taking advantage of that way more efficiently than any of my emp…

Meant to say employer(s).

Re: Promising results from DeepSeek R1 for code

#587

Post by ghostpepper »

throwu2728828 wrote: post #426
ldjkfkdsjnv wrote: post #400

Earlier quoted context omitted.

I fully believe this as well. And I have 15 years of SWE experience at top tech. Its over for this field

[flagged]

> Not enough ideas or interest to get into LLMs before they frankly left the station completely.

My dad was introduced to boolean algebra and the ideas of early computing in high school in the early 1960s and found it interesting but didn't pursue a career in it because he figured all the interesting problems had already been solved. He ended up having a successful career in something unrelated but he always tells the story as a cautionary tale.

I don't think it's too late for anyone to learn LLM internals, especially if they're young.

Re: Promising results from DeepSeek R1 for code

#588

Post by test6554 »

LeoPanthera wrote: post #226

Going from English to code via AI feels a lot like going from code to binary via a compiler. I wonder how long it will be before we eliminate the middle step and just go straight from English to binary, or even just develop an AI interpreter that can execute English directly without having to "compile" it first.

"Make me a big-ass car" vs "Make me a big ass-car"

Re: Promising results from DeepSeek R1 for code

#589

Post by btilly »

svara wrote: post #403
btilly wrote: post #336

Earlier quoted context omitted.

Jevon's Paradox says that you're probably wrong. But I'm worried about the same thing. The moat around human superiority is shrinking fast. And when it's gone, we may get more software, but will we need humans involved?

AI doesn't have needs any desires, humans do. And no matter how hyped one might be about AI, we're far away from creating an artificial human. As long as that's true, AI is a tool to make humans more effective.

AI may not have desires, but corporations do. And control more resources than humans.

Making corporations more effective is not always in the interest of humans.

Re: Promising results from DeepSeek R1 for code

#590

Post by stickfigure »

koito17 wrote: post #429
abc-1 wrote: post #389

Earlier quoted context omitted.

Why do people keep talking about this? We get it, Chinese models are censored by CCP law. Can we stop talking about it now? I swear this must be some sort of psyop at this point.

Mostly anti-Chinese bias from Americans, Western Europeans, and people aligned with that axis of power (e.g. Japan). However, on the Japanese internet, I don't see this obsession with taboo Chinese topics like on Hacker News. People on Hacker News will rave about 天安門事件 but they will never have heard of the South Korean equivalent (cf. 光州事件) which was supported by the United States government. I try to avoid discussin…

> since China has laws against misinformation

since China has laws against information

Fixed that for you.

Post reply on HN