I have yet to see evidence that it is better for agentic coding tasks than GLM-4.5
Is that it? Nothing else you haven't seen evidence for?
Just that
DeepSeek-v3.1
201–210 of 273 posts
Re: DeepSeek-v3.1
#202how can deepseek be so cheap* yet so effective?
*pricing: MODEL deepseek-chat deepseek-reasoner 1M INPUT TOKENS (CACHE HIT) $0.07 1M INPUT TOKENS (CACHE MISS) $0.56 1M OUTPUT TOKENS $1.68
Re: DeepSeek-v3.1
#203just saw this on Chinese internet - deepseek officially mentioned that v3.1 is trained using UE8M0 FP8 as that is the FP8 to be supported by the next gen Chinese AI chip. so basically - some Chinese next gen AI chips is coming, deepseek is working with them to get its flagship model trained using such domestic chips. interesting time ahead! just imagine what it could do to NVIDIA share price when deepseek releases a…
Time to short Nvidia?
Re: DeepSeek-v3.1
#204Earlier quoted context omitted.
DeepSeek is bad for hallucinations in my experience. I wouldn't trust its output for anything serious without heavy grounding. It's great for fantastical fiction though. It also excels at giving characters "agency".
Where would you go to find people posting their AI generated fiction? I haven't been able to find it on Reddit
Amazon, Barnes & Noble, Powell's, the usual places.
Re: DeepSeek-v3.1
#205how can deepseek be so cheap* yet so effective? *pricing: MODEL deepseek-chat deepseek-reasoner 1M INPUT TOKENS (CACHE HIT) $0.07 1M INPUT TOKENS (CACHE MISS) $0.56 1M OUTPUT TOKENS $1.68
I think it's because of a combination between the MoE model architecture and the inference done in large batches and run in parallel
Re: DeepSeek-v3.1
#206Earlier quoted context omitted.
I think you misunderstood rfoos suggestion slightly. From how I interpreted it, he meant you could create a new python package, this would effectively be the binary you need. In your current package, you could depend on the new one, and through that - pull in the binary. This would let you easily decouple your package from the binary,too - so it'd be easy to update the binary to latest even without pushing a new vers…
Oh ok sorry maybe I misunderstood sorry! I actually found my partial work I did for precompiled binaries! https://huggingface.co/datasets/unsloth/precompiled_llama_cp... I was trying to see if I could pre-compile some llama.cpp binaries then save them as a zip file (I'm a noob sorry) - but I definitely need to investigate further on how to do python pip binaries
Re: DeepSeek-v3.1
#207Earlier quoted context omitted.
Something I was doing informally that seems very effective is asking for details about smaller cities and towns and lesser points of interest around the world. Bigger models tend to have a much better understanding and knowledge base for the more obscure places.
I would really love if they figured out how to train a model that doesn't have any such knowledge baked it, but knows where to look for it. Maybe even has a clever database for that. Knowing this kind of trivia like this consistently of the top of your head is a sign of deranged mind, artificial or not.
The problem is that these models can't reason about what they do and do not know, so right now you basically need to tune it to:
1) always look up all trivia, or
2) occasionally look up trivia when it "seems complex" enough.
Re: DeepSeek-v3.1
#208Earlier quoted context omitted.
Dude, this is NEVER ok. What in the world??? A third party LIBRARY running sudo commands? That’s just insane. You just fail and print a nice error message telling the user exactly what they need to do, including the exact apt command or whatever that they need to run.
How unusual is this for the ecosystem?
Unfortunately, Python ecosystem is the Wild West.
Re: DeepSeek-v3.1
#209Earlier quoted context omitted.
DeepSeek is bad for hallucinations in my experience. I wouldn't trust its output for anything serious without heavy grounding. It's great for fantastical fiction though. It also excels at giving characters "agency".
Where would you go to find people posting their AI generated fiction? I haven't been able to find it on Reddit
AO3 has several tags for it.
Re: DeepSeek-v3.1
#210Reminder DeepSeek is a Chinese company whose headstart is attributed to stealing IP from American companies. Without the huge theft, they'd be nowhere.