Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The path to open-sourcing the DeepSeek inference engine

github.com

Post reply on HN
Print view View original

11–20 of 69 posts

Re: The path to open-sourcing the DeepSeek inference engine

#11

Post by rfoo »

Havoc wrote: post #3
rfoo wrote: post #2

tl;dr "we had our vLLM fork and it's unmaintainable now; guess we are going to rebuild it, in the public this time"

Unmaintainable seems unduly harsh. There is a big gap between maintainable internally and ready for public consumption

> Codebase Divergence: Our engine is based on an early fork of vLLM from over a year ago

If you are in the same boat you'll see how much changed in vLLM compared to one year ago. Also, this meant that they haven't rebased for over a year, I don't believe that's because they don't want, it's because they effectively can't.

Yeah, surely they can maintain it as-is. But it will be increasingly hard to port over anything community has.

Re: The path to open-sourcing the DeepSeek inference engine

#15

Post by sampton »

nashashmi wrote: post #13

I feel like this is one way to implement censorship.

There's an ongoing debate whether LLM should be considered intelligent when it's just generating tokens from latent space. Meanwhile there are humans that are only capable of spitting out the same 5 tokens yet still considered to be "intelligent".

Re: The path to open-sourcing the DeepSeek inference engine

#17

Post by avodonosov »

What motivates the commercial AI companies to share their research results and know-how?

Why did Google published the Transformer architecture instead of keeping it to themselves?

I understand that people may want to do good things for humanity, facilitate progress, etc. But if an action goes against commercial interest, how can the company management take it and not get objections from shareholders?

Or there is a commercial logic that motivates sharing of information and intellectual property? What logic is that?

Re: The path to open-sourcing the DeepSeek inference engine

#18

Post by varelse »

avodonosov wrote: post #17

What motivates the commercial AI companies to share their research results and know-how? Why did Google published the Transformer architecture instead of keeping it to themselves? I understand that people may want to do good things for humanity, facilitate progress, etc. But if an action goes against commercial interest, how can the company management take it and not get objections from shareholders? Or there is a co…

[dead]

Re: The path to open-sourcing the DeepSeek inference engine

#19

Post by lofaszvanitt »

avodonosov wrote: post #17

What motivates the commercial AI companies to share their research results and know-how? Why did Google published the Transformer architecture instead of keeping it to themselves? I understand that people may want to do good things for humanity, facilitate progress, etc. But if an action goes against commercial interest, how can the company management take it and not get objections from shareholders? Or there is a co…

The more people copy your outdated thing, the better for you, because they always gonna lag behind you.

Re: The path to open-sourcing the DeepSeek inference engine

#20

Post by bcoughlan »

avodonosov wrote: post #17

What motivates the commercial AI companies to share their research results and know-how? Why did Google published the Transformer architecture instead of keeping it to themselves? I understand that people may want to do good things for humanity, facilitate progress, etc. But if an action goes against commercial interest, how can the company management take it and not get objections from shareholders? Or there is a co…

I would guess it comes down to that the best researchers in the world want their work out in the open
Post reply on HN