Benchmarking 15 “E-Waste” GPUs with Modern Workloads
1–10 of 68 posts
Re: Benchmarking 15 “E-Waste” GPUs with Modern Workloads
#2Great read. I'd love to know more about how power consumption changes as cards get newer too!
Re: Benchmarking 15 “E-Waste” GPUs with Modern Workloads
#3Darn, I was hoping to see bc-250's (aka PS5 chips) in there. They've recently become popular for inference and they are only about $200 on ebay. They hold a special place in my heart because I deployed 20k of them and I'm glad to see they are finding a purpose now and not just e-waste.
Re: Benchmarking 15 “E-Waste” GPUs with Modern Workloads
#4Darn, I was hoping to see bc-250's (aka PS5 chips) in there. They've recently become popular for inference and they are only about $200 on ebay. They hold a special place in my heart because I deployed 20k of them and I'm glad to see they are finding a purpose now and not just e-waste.
Wow holy crap this is news to me! I will have to consider picking some of these up for testing, what is it like working with them?
Re: Benchmarking 15 “E-Waste” GPUs with Modern Workloads
#5Great read. I'd love to know more about how power consumption changes as cards get newer too!
Thanks! Yeah this is a major consideration. I have looked at power consumption throughout runs in the past (https://esologic.com/gpu-server-benchmark/#gpu-box-benchmark) and found that for many of these enterprise class cards, they're happy to slam right into the max TDP. So, for doing actual work, you'll be living up closer to the rated TDP of the cards. Recording power consumption is easy on nvidia and I'll likely add this to future versions of the benchmarking tool.
Re: Benchmarking 15 “E-Waste” GPUs with Modern Workloads
#6Darn, I was hoping to see bc-250's (aka PS5 chips) in there. They've recently become popular for inference and they are only about $200 on ebay. They hold a special place in my heart because I deployed 20k of them and I'm glad to see they are finding a purpose now and not just e-waste.
Interesting! I had only heard of them as cheap gaming boxes. Didn't know they were being used for cheap inference, too, but it makes sense.
> They hold a special place in my heart because I deployed 20k
Sounds like something I'd love to hear more about if you can share
Re: Benchmarking 15 “E-Waste” GPUs with Modern Workloads
#7Darn, I was hoping to see bc-250's (aka PS5 chips) in there. They've recently become popular for inference and they are only about $200 on ebay. They hold a special place in my heart because I deployed 20k of them and I'm glad to see they are finding a purpose now and not just e-waste.
Interesting! I had only heard of them as cheap gaming boxes. Didn't know they were being used for cheap inference, too, but it makes sense. > They hold a special place in my heart because I deployed 20k Sounds like something I'd love to hear more about if you can share
ethereum mining, long shut down...
Re: Benchmarking 15 “E-Waste” GPUs with Modern Workloads
#8Darn, I was hoping to see bc-250's (aka PS5 chips) in there. They've recently become popular for inference and they are only about $200 on ebay. They hold a special place in my heart because I deployed 20k of them and I'm glad to see they are finding a purpose now and not just e-waste.
Wow holy crap this is news to me! I will have to consider picking some of these up for testing, what is it like working with them?
there is a discord server for fans of bc-250... lots of information there.
Re: Benchmarking 15 “E-Waste” GPUs with Modern Workloads
#9Have you tried 27B class models like qwen3.6?
Re: Benchmarking 15 “E-Waste” GPUs with Modern Workloads
#10Have you tried 27B class models like qwen3.6?
This initial round of benchmarking was to understand if there was any usecase here at all and I think there is. In a follow up, I'll be trying to answer questions like this. How big of a model can you fit on 4x M60, 4x P100, 4x V100? What are the tok/second when varying context length?
Do you have a set of models you'd like me to look at?