Deepseek R1-0528

#1

Post by error404x » Wed, May 28, 2025, 5:59 PM UTC

Re: Deepseek R1-0528

#2

Post by transcriptase » Wed, May 28, 2025, 6:23 PM UTC

Out of sheer curiosity: What’s required for the average Joe to use this, even at a glacial pace, in terms of hardware? Or is it even possible without using smart person magic to append enchanted numbers and make it smaller for us masses?

Re: Deepseek R1-0528

#3

Post by jacob019 » Wed, May 28, 2025, 6:23 PM UTC

Not much to go off of here. I think the latest R1 release should be exciting. 685B parameters. No model card. Release notes? Changes? Context window? The original R1 has impressive output but really burns tokens to get there. Can't wait to learn more!

Re: Deepseek R1-0528

#4

Post by willchen » Wed, May 28, 2025, 6:24 PM UTC

I love how Deepseek just casually drops new updates (that deliver big improvements) without fanfare.

Re: Deepseek R1-0528

#5

Post by jacob019 » Wed, May 28, 2025, 6:24 PM UTC

transcriptase wrote: post #2

Out of sheer curiosity: What’s required for the average Joe to use this, even at a glacial pace, in terms of hardware? Or is it even possible without using smart person magic to append enchanted numbers and make it smaller for us masses?

I'm sure it will be on OpenRouter within the next day or so. Not really practical to run a 685B param model at home.

Re: Deepseek R1-0528

#6

Post by behohippy » Wed, May 28, 2025, 6:31 PM UTC

transcriptase wrote: post #2

Out of sheer curiosity: What’s required for the average Joe to use this, even at a glacial pace, in terms of hardware? Or is it even possible without using smart person magic to append enchanted numbers and make it smaller for us masses?

About 768 gigs of ddr5 RAM in a dual socket server board with 12 channel memory and an extra 16 gig or better GPU for prompt processing. It's a few grand just to run this thing at 8-10 tokens/s

Re: Deepseek R1-0528

#7

Post by terhechte » Wed, May 28, 2025, 6:31 PM UTC

transcriptase wrote: post #2

Out of sheer curiosity: What’s required for the average Joe to use this, even at a glacial pace, in terms of hardware? Or is it even possible without using smart person magic to append enchanted numbers and make it smaller for us masses?

You can run the 4bit quantized version of it on a M3 Ultra 512GB. That's quite expensive though. Another alternative is a fast CPU with 500GB of DDR5 RAM. That of course, is also not cheap and slower than the M3 Ultra. Or, you buy multiple Nvidia cards to reach ~500GB of VRam. That is probably the most expensive option but also the fastest

Re: Deepseek R1-0528

#8

Post by [deleted] » Wed, May 28, 2025, 6:32 PM UTC

transcriptase wrote: post #2

Out of sheer curiosity: What’s required for the average Joe to use this, even at a glacial pace, in terms of hardware? Or is it even possible without using smart person magic to append enchanted numbers and make it smaller for us masses?

[deleted]

Re: Deepseek R1-0528

#9

Post by hu3 » Wed, May 28, 2025, 6:33 PM UTC

transcriptase wrote: post #2

Out of sheer curiosity: What’s required for the average Joe to use this, even at a glacial pace, in terms of hardware? Or is it even possible without using smart person magic to append enchanted numbers and make it smaller for us masses?

It's probably going to be free at OpenRouter.

There's already a 685B parameter DeepSeek V3 for free there.

https://openrouter.ai/deepseek/deepseek-chat-v3-0324:free

Re: Deepseek R1-0528

#10

Post by _lvbh » Wed, May 28, 2025, 6:36 PM UTC

No information to be found about it. Hopefully we get benchmarks soon. Reminds me of the days when Mistral would just tweet a torrent magnet link