Live data from Hacker News

The path to open-sourcing the DeepSeek inference engine

github.com

31–40 of 69 posts

Re: The path to open-sourcing the DeepSeek inference engine

#31
post #21

What motivates the commercial AI companies to share their research results and know-how? Why did Google published the Transformer architecture instead of keeping it to themselves? I understand that people may want to do good things for humanity, facilitate progress, etc. But if an action goes against commercial interest, how can the company management take it and not get objections from shareholders? Or there is a co…

My understanding is that frontier researchers will work for companies that will let them publish papers and discuss them with their peers. When you're an engineer at the tier of these AI researchers, winning an extra 100k/year on top of you current 500k (numbers out of my ass) is not worth it vs getting name recognition. Being known as one of the authors that made the transformer for example will enable you work with…

[deleted]

Re: The path to open-sourcing the DeepSeek inference engine

#32

What motivates the commercial AI companies to share their research results and know-how? Why did Google published the Transformer architecture instead of keeping it to themselves? I understand that people may want to do good things for humanity, facilitate progress, etc. But if an action goes against commercial interest, how can the company management take it and not get objections from shareholders? Or there is a co…

Indeed, is there a chance Google did not evaluate properly what the transformer will eventually be used for/become. It was created for translation as an improvement on seq2seq, right? Which was for translation, not for thinking, and to a certain extent... still is about translation, and are not other emergent capabilities actually a side-effect, only observed later when parameter size grew?

Re: The path to open-sourcing the DeepSeek inference engine

#33
post #27

What motivates the commercial AI companies to share their research results and know-how? Why did Google published the Transformer architecture instead of keeping it to themselves? I understand that people may want to do good things for humanity, facilitate progress, etc. But if an action goes against commercial interest, how can the company management take it and not get objections from shareholders? Or there is a co…

Well Deepseek's survival also depends on the giant amount of hype they can generate, and they won't get more investor money just by having done a one-hit wonder. Becoming deeply integrated in the AI ecosystem with various tools and innovative discoveries will most like be more beneficial than protecting the secrets of their first success.

Deepseek doesn't need hype to survive. They are bankrolled by their now billionaire founder.

Re: The path to open-sourcing the DeepSeek inference engine

#34

"We have something that would be of interest to the open source community, but it needs a lot of tidying to even run outside our company, and we don't have the manpower to properly maintain it when released". Plenty of companies are in this position. Please just open source anyway with a note saying "we won't be maintaining this, but feel free to fork!"

Unfortunately that's not really feasible in the current state of open source. There are enormous numbers of entitled users out there who become a parasitic drain on any project that is open sourced. Solo maintainers can theoretically just develop a think skin, but companies can actually find that the damage to their public image from not having their FOSS project in tip top shape is greater than the benefits of open sourcing it in the first place.

Re: The path to open-sourcing the DeepSeek inference engine

#35

"We have something that would be of interest to the open source community, but it needs a lot of tidying to even run outside our company, and we don't have the manpower to properly maintain it when released". Plenty of companies are in this position. Please just open source anyway with a note saying "we won't be maintaining this, but feel free to fork!"

Unfortunately that's not really feasible in the current state of open source. There are enormous numbers of entitled users out there who become a parasitic drain on any project that is open sourced. Solo maintainers can theoretically just develop a think skin, but companies can actually find that the damage to their public image from not having their FOSS project in tip top shape is greater than the benefits of open…

You can always just disable issues and all other feedback channels. I judge companies on the state of their open source libraries, but it really depends on how the company positions it. Facebook pushed for react to become the default framework, so they deserve the scrutiny when it doesn’t hold up. However, with a clear disclaimer like that? I think that people would have different expectations.

Re: The path to open-sourcing the DeepSeek inference engine

#36

What motivates the commercial AI companies to share their research results and know-how? Why did Google published the Transformer architecture instead of keeping it to themselves? I understand that people may want to do good things for humanity, facilitate progress, etc. But if an action goes against commercial interest, how can the company management take it and not get objections from shareholders? Or there is a co…

> Or there is a commercial logic that motivates sharing of information and intellectual property? What logic is that?

There absolutely is a sound commercial justification to share research: long-term growth through advancement of the field. (Deep learning would never have made the progress it has without open research!)

If this seems quaint, it’s because we’re too accustomed to short-term, transactional, Wall Street thinking.

Re: The path to open-sourcing the DeepSeek inference engine

#37

What motivates the commercial AI companies to share their research results and know-how? Why did Google published the Transformer architecture instead of keeping it to themselves? I understand that people may want to do good things for humanity, facilitate progress, etc. But if an action goes against commercial interest, how can the company management take it and not get objections from shareholders? Or there is a co…

> Or there is a commercial logic that motivates sharing of information and intellectual property? What logic is that? There absolutely is a sound commercial justification to share research: long-term growth through advancement of the field. (Deep learning would never have made the progress it has without open research!) If this seems quaint, it’s because we’re too accustomed to short-term, transactional, Wall Street…

It's not so much that it seems quaint, it's that we are accustomed to short-term, transactional, Wall Street thinking from companies like Google.

For very good reason, because that's exactly how they behave in all other areas. The question remains, why do they appear altruistic when it comes to sharing papers?

I find it hard to believe that it's actual altruism. It's far more likely that it's transactional behavior that just appears altruistic from the outside.

Re: The path to open-sourcing the DeepSeek inference engine

#38

Earlier quoted context omitted.

I would guess it comes down to that the best researchers in the world want their work out in the open

Ilya doesn't. He's a strong proponent of closed source and censorship.

He is just one person. He happens to be the most famous scientist working on this field at the moment it became a gold rush, but it's work built on the shoulders of those who came before, whose discoveries are just as important.

Re: The path to open-sourcing the DeepSeek inference engine

#39

Earlier quoted context omitted.

> Or there is a commercial logic that motivates sharing of information and intellectual property? What logic is that? There absolutely is a sound commercial justification to share research: long-term growth through advancement of the field. (Deep learning would never have made the progress it has without open research!) If this seems quaint, it’s because we’re too accustomed to short-term, transactional, Wall Street…

It's not so much that it seems quaint, it's that we are accustomed to short-term, transactional, Wall Street thinking from companies like Google. For very good reason, because that's exactly how they behave in all other areas. The question remains, why do they appear altruistic when it comes to sharing papers? I find it hard to believe that it's actual altruism. It's far more likely that it's transactional behavior t…

Everyone benefits from the gains, everyone gets more customers and more investment.

Re: The path to open-sourcing the DeepSeek inference engine

#40

"We have something that would be of interest to the open source community, but it needs a lot of tidying to even run outside our company, and we don't have the manpower to properly maintain it when released". Plenty of companies are in this position. Please just open source anyway with a note saying "we won't be maintaining this, but feel free to fork!"

Unfortunately that's not really feasible in the current state of open source. There are enormous numbers of entitled users out there who become a parasitic drain on any project that is open sourced. Solo maintainers can theoretically just develop a think skin, but companies can actually find that the damage to their public image from not having their FOSS project in tip top shape is greater than the benefits of open…

Just put a tarball url on a plain website then. No community interaction required to share code
Post reply on HN