You gotta love these guys, they're really pushing the open source frontier for all of us, thanks for sharing
Open AI™ (with a space)
I hope you're reading this Sam Altman:
Make Open AI open.
Or else you'll lose to the ecosystem.
DeepSeek open source DeepEP – library for MoE training and Inference
11–20 of 77 posts
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#12Round 2 of open source releases from an actual "Open AI™" company and licensed under MIT.
Once again, DeepSeek is more open than the $157B+ one that is claiming to be "Open".
Almost no-one is talking about Meta's Llama and everyone should expect them to release Llama 4 with reasoning.
The objective is to not be squeezed in the middle of the race to zero.
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#13Is the PTX that everyone was looking forward to included this time?
Yes, there's some in the csrc/kernels directory. Search for 'asm' to find uses of it.
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#14The PTX instructions they talked about in the tech report should be pointing to the code here?
"For extreme performance, we discover and use a behavior-out-of-doc PTX instruction: ld.global.nc.L1::no_allocate.L2::256B. This instruction will lead to an undefined behavior: accessing volatile GPU memory with non-coherent read-only PTX modifiers .nc. But the correctness is tested to be guaranteed with .L1::no_allocate on Hopper architectures, and performance will be much better. If you find kernels not working on some other platforms, you may add DISABLE_AGGRESSIVE_PTX_INSTRS=1 to setup.py and disable this, or file an issue."
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#15Is the PTX that everyone was looking forward to included this time?
> the PTX that everyone was looking forward to
explanation for the rest of us why this is so important?
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#16Round 2 of open source releases from an actual "Open AI™" company and licensed under MIT. Once again, DeepSeek is more open than the $157B+ one that is claiming to be "Open". Almost no-one is talking about Meta's Llama and everyone should expect them to release Llama 4 with reasoning. The objective is to not be squeezed in the middle of the race to zero.
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#17Now it includes the highly anticipated PTX! Of course, I don’t understand it, but I’ve already click the star and even the fork button, which basically means I’ve mastered it, right? I feel incredibly powerful right now...
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#18Earlier quoted context omitted.
Kind of ironic that DeepSeek is more Open than ChatGPT
They do it for their own reasons, but OpenAI are straight up liars and they are neither open nor give a fuck about humanity.
OpenAyyyyI swear babe I’m gonna open it up any day. Yeah for that grated good or whatever it is you keep yappin about.
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#19Is the PTX that everyone was looking forward to included this time?
> the PTX that everyone was looking forward to explanation for the rest of us why this is so important?
Much of the hype around DeepSeek is due to their extraordinarily low training and inference costs. They achieved this by optimizing their training code, apparently using PTX in addition to CUDA. PTX is kind of an intermediate assembly language for NVIDIA GPUs and people are eager to see how it was used.
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#20Earlier quoted context omitted.
Open AI™ (with a space)
Kind of ironic that DeepSeek is more Open than ChatGPT
Now. It’s amazing to me that everyone is like fuck OpenAI deepseek is the savior, when OpenAI’s papers and code jump started an AI revolution just a few years ago. Let’s wait the same number of years and see what deepseek does.