DeepSeek-v3.1 • Hacker News Board

Re: DeepSeek-v3.1

#231

Post by lucianbr » Fri, Aug 22, 2025, 4:59 PM UTC

dmos62 wrote: post #170

irthomasthomas wrote: post #157

Earlier quoted context omitted.

It just means that once you send your test questions to a model API, that company now has your test. So 'private' benchmarks take it on faith that the companies won't look at those requests and tune their models or prompts to beat them.

Sounds a bit presumptious to me. Sure, they have your needle, but they also need a cost-efficient way to find it in their hay stack.

They have quite large amounts of money. I don't think they need to be very cost-efficient. And they also have very smart people, so likely they can figure out a somewhat cost-efficient way. The stakes are high, for them.

Re: DeepSeek-v3.1

#232

Post by mach5 » Fri, Aug 22, 2025, 5:06 PM UTC

hereme888 wrote: post #210

Reminder DeepSeek is a Chinese company whose headstart is attributed to stealing IP from American companies. Without the huge theft, they'd be nowhere.

who cares

Re: DeepSeek-v3.1

#233

Post by pshirshov » Fri, Aug 22, 2025, 5:27 PM UTC

exe34 wrote: post #104

pshirshov wrote: post #60

Earlier quoted context omitted.

By the way, I'm wondering why unsloth (a goddamn python library) tries to run apt-get with sudo (and fails on my nixos). Like how tf we are supposed to use that?

hey fellow crazy person! slight tangent: one thing that helps keep me grounded with "LLMs are doing much more than regurgitation" is watching them try to get things to work on nixos - and hitting every rake on the way to hell! nixos is such a great way to expose code doing things it shouldn't be doing.

In my experience LLMs can do Nix very well, even the models I run locally. I just instruct them to pull dependencies through flake.nix and use direnv to run stuff.

Re: DeepSeek-v3.1

#234

Post by techlatest_net » Fri, Aug 22, 2025, 5:31 PM UTC

[dead]

Re: DeepSeek-v3.1

#235

Post by linuxftw » Fri, Aug 22, 2025, 5:56 PM UTC

jkingsman wrote: post #228

linuxftw wrote: post #197

Earlier quoted context omitted.

That's true only in a vacuum. For example, should I run gpt-oss-20b unquantized or gpt-oss-120b quantaized? Some models have a 70b/30b spread, and that's only across a single base model, where many different models exist at different quants could be compared for different tasks.

Definitely. As a hobbyist, I have yet to put together a good heuristic for better-quant-lower-params vs. smaller-quant-high-params. I've mentally been drawing the line at around q4, but now with IQ quants and improvements in the space I'm not so sure anymore.

Yeah, I've kinda quickly thrown in the towel trying to figure out what's 'best' for smaller memory systems. As things are just moving so quickly, whatever time I invest into that is likely to be for nil.

Re: DeepSeek-v3.1

#236

Post by bigyabai » Fri, Aug 22, 2025, 6:04 PM UTC

petesergeant wrote: post #187

indigodaddy wrote: post #168

Earlier quoted context omitted.

How would you compare gpt-oss-120b to (for coding): Qwen3-Coder-480B-A35B-Instruct GLM4.5 Air Kimi K2 DeepSeek V3 0324 / R1 0528 GPT-5 Mini Thanks for any feedback!

I’m afraid I don’t use any of those for coding

You're missing out. GLM 4.5 Air and Qwen3 A3B both blow OSS 120B out of the water in my experience.

Re: DeepSeek-v3.1

#237

Post by bigyabai » Fri, Aug 22, 2025, 6:05 PM UTC

indigodaddy wrote: post #57

bigyabai wrote: post #6

Earlier quoted context omitted.

Those Qwen3 2507 models are the local creme-de-la-creme right now. If you've got any sort of GPU and ~32gb of RAM to play with, the A3B one is great for pair-programming tasks.

Do we get these good qwen models when using qwen-code CLI tool and authing via qwen.ai account?

I'm not sure, probably?

Re: DeepSeek-v3.1

#238

Post by Leynos » Fri, Aug 22, 2025, 6:11 PM UTC

bgilroy26 wrote: post #224

1gn15 wrote: post #209

Earlier quoted context omitted.

AO3 has several tags for it.

I should have said, I am looking for posted chat logs where the prompts are shared as well. I really enjoy the process of making stories with AI and I am curious to see how others do the same thing.

Look at NovelCrafter.

They have a great Discord community where people share their prompts and workflows.

There is also the WritingWithAI subreddit.

Re: DeepSeek-v3.1

#239

Post by indigodaddy » Fri, Aug 22, 2025, 6:13 PM UTC

bigyabai wrote: post #236

petesergeant wrote: post #187

Earlier quoted context omitted.

I’m afraid I don’t use any of those for coding

You're missing out. GLM 4.5 Air and Qwen3 A3B both blow OSS 120B out of the water in my experience.

Ah good to hear! How about Qwen3-Coder-480B-A35B-Instruct? I believe that is the free Qwen3-coder model on openrouter

Re: DeepSeek-v3.1

#240

Post by Computer0 » Fri, Aug 22, 2025, 6:13 PM UTC

segmondy wrote: post #163

danielhanchen wrote: post #146

Earlier quoted context omitted.

Hmmm I'm worried people will really not get on how to install / compile / use the terminal hmmm hence I thought permissions were like a compromise solution

Don't listen to this crowd, these are "technical folks". Most of your audience will fail to figure it out. You can provide an option that llama.cpp is missing and give them an option where you auto install it or they can install it themselves and do manual configuration. I personally won't tho.

Who do you think the audience is here if not technical. We are in a discussion about a model that requires over 250gb of ram to run. I don't know a non-technical person with more than 32gb.