Live data from Hacker News

The path to open-sourcing the DeepSeek inference engine

github.com

61–69 of 69 posts

Re: The path to open-sourcing the DeepSeek inference engine

#62
As much as I want to geek out and run the things locally, if I have the money I just want to use a SaaS. I want to spend time creating new applications and not toy around with setup, infrastructure etc. I’d gladly pay ChatGPT even more if they keep up with features and they seem to have done that quite well since deepseek (new models often, best image gen hands down, very fast inference compared to 6 months back and even small things like memory).

I sometimes feel guilty though. With all this power, I’m just bounded by lack of ideas and execution.

Re: The path to open-sourcing the DeepSeek inference engine

#63

What motivates the commercial AI companies to share their research results and know-how? Why did Google published the Transformer architecture instead of keeping it to themselves? I understand that people may want to do good things for humanity, facilitate progress, etc. But if an action goes against commercial interest, how can the company management take it and not get objections from shareholders? Or there is a co…

If google never published it (and we pretend like it would not have leaked) then we would never have the LLM:s we have today (including Googles). Everyone would loose.

Re: The path to open-sourcing the DeepSeek inference engine

#65

Earlier quoted context omitted.

It's not so much that it seems quaint, it's that we are accustomed to short-term, transactional, Wall Street thinking from companies like Google. For very good reason, because that's exactly how they behave in all other areas. The question remains, why do they appear altruistic when it comes to sharing papers? I find it hard to believe that it's actual altruism. It's far more likely that it's transactional behavior t…

People may be altruistic, but in a company setting they may have no possibility for altruism. CEO decisions influence property of others (the shareholders) so he can not freely pursue altruistic goals. I heard that Dodge v. Ford Motor Co. was an important precedent in the US. https://en.m.wikipedia.org/wiki/Dodge_v._Ford_Motor_Co .

These days the courts give wide latitude to companies to offer virtually any plausible reason why superficially altruistic acts are in fact good long term for shareholder value. Anyone wanting to do what Ford did just needs to keep their mouth shut about the real reasons.

Re: The path to open-sourcing the DeepSeek inference engine

#66
post #65

Earlier quoted context omitted.

People may be altruistic, but in a company setting they may have no possibility for altruism. CEO decisions influence property of others (the shareholders) so he can not freely pursue altruistic goals. I heard that Dodge v. Ford Motor Co. was an important precedent in the US. https://en.m.wikipedia.org/wiki/Dodge_v._Ford_Motor_Co .

These days the courts give wide latitude to companies to offer virtually any plausible reason why superficially altruistic acts are in fact good long term for shareholder value. Anyone wanting to do what Ford did just needs to keep their mouth shut about the real reasons.

Interesting. Do you know any particular court cases?

My wikipedia link above in turn links to https://en.m.wikipedia.org/wiki/Shareholder_primacy, which says in the last paragraph: "The doctrine waned in later years."

This probably confirms what you say, but I'd be interested to learn about specific cases.

Re: The path to open-sourcing the DeepSeek inference engine

#67
post #52

What motivates the commercial AI companies to share their research results and know-how? Why did Google published the Transformer architecture instead of keeping it to themselves? I understand that people may want to do good things for humanity, facilitate progress, etc. But if an action goes against commercial interest, how can the company management take it and not get objections from shareholders? Or there is a co…

It's worth noting that, while a noteworthy paper, nobody really expected the Transformer at the time to be the breakthrough it eventually became.

Transformer is just an example. We observe a constant stream of information shared by companies, even now, when "AI" is booming.

Re: The path to open-sourcing the DeepSeek inference engine

#69

I spent the last two or so months using it as an assistant for code and my conclusion is that it is terrible compared to even the free model of ChatGPT. The incidence of bugs, it not understanding what you're asking or just generating code that is straight up wrong is much worse. Even with guidance it will often be unable to fix issues, leaving you to do all the manual legwork to get things working. Usually you're be…

That’s interesting since this has been my exact opposite experience. What type of coding are you doing? Did you locally roll your own coding assistant with a local model of DeepSeek or are you prompting via the web?

Same for me, the reasoning model is really useful.
Post reply on HN