Live data from Hacker News

DeepSeek-R1 at 3,872 tokens / second on a single Nvidia HGX H200

blogs.nvidia.com

Post reply on HN

Print view View original

1–3 of 3 posts

DeepSeek-R1 at 3,872 tokens / second on a single Nvidia HGX H200

#1

Post by moondistance » Fri, Jan 31, 2025, 3:08 AM UTC

DeepSeek-R1 at 3,872 tokens / second on a single Nvidia HGX H200
blogs.nvidia.com

Re: DeepSeek-R1 at 3,872 tokens / second on a single Nvidia HGX H200

#2

Post by [deleted] » Fri, Jan 31, 2025, 3:11 AM UTC

[deleted]

Re: DeepSeek-R1 at 3,872 tokens / second on a single Nvidia HGX H200

#3

Post by billconan » Fri, Jan 31, 2025, 3:59 AM UTC

https://news.ycombinator.com/item?id=42879864

this is cerebras' 70B number, 1600 tokens / sec, not sure about the costs.

Post reply on HN