Show HN: Open-source calculator for "will my GPU run this LLM?"
jaeseok614.github.io
Show HN: Open-source calculator for "will my GPU run this LLM?"
1–7 of 7 posts
Re: Show HN: Open-source calculator for "will my GPU run this LLM?"
#2[flagged]
Re: Show HN: Open-source calculator for "will my GPU run this LLM?"
#3Very useful project for quick comparisons! One question: in the "recommended settings" where the quantisation are shown, e.g., "Q6_K", are Unsloth dynamic quantisations also considered or available to compare with?
Re: Show HN: Open-source calculator for "will my GPU run this LLM?"
#4Very useful project for quick comparisons! One question: in the "recommended settings" where the quantisation are shown, e.g., "Q6_K", are Unsloth dynamic quantisations also considered or available to compare with?
[flagged]
Re: Show HN: Open-source calculator for "will my GPU run this LLM?"
#5It's incredibly useful! Takes all the guesswork out of provisioning servers for local agent deployments. Thanks for open-sourcing this.
Re: Show HN: Open-source calculator for "will my GPU run this LLM?"
#6[dead]
Re: Show HN: Open-source calculator for "will my GPU run this LLM?"
#7I tried to create a similar site myself a while back, but the biggest challenge was that the margin of error was just too wide. I checked various benchmarks for different GPUs, but there were cases where the results differed, and there were just too many factors that influenced the results—such as the graphics card generation and whether quantization was enabled.