Live data from Hacker News

Show HN: Find the best local LLM for your hardware, ranked by benchmarks

github.com

61–70 of 80 posts

Re: Show HN: Find the best local LLM for your hardware, ranked by benchmarks

#62

1. The results of this tool are not good. It’s recommending outdated models like Qwen2.5 series and missing good new models. 2. This could have been a single web page that runs in your browser and lets you enter hardware specs, like all of the other tools like this. It is not a good idea to install and run unknown projects like this on your computer in this age. 3. The project is very obviously vibecoded, down to the…

There is apparently a marketing.md file that was deleted 25min ago with the strategy to post on HN. https://github.com/Andyyyy64/whichllm/commit/2cefaea1cc5d2de... I think your hunch is very much spot on. It doesn’t look trustworthy at all.

That’s amazing. Everyone has noticed all of the AI slop projects being posted to Show HN and r/localllama but this is the first time I’m seeing the AI text that is telling people to do this. I was naive enough to think these people had the idea to post the project on their own, but even the idea to post it is coming from the LLMs. Amazing.

EDIT: r/selfhosted is in there too. This explains why that subreddit is having such a problem with AI slop project spam.

Re: Show HN: Find the best local LLM for your hardware, ranked by benchmarks

#64

Earlier quoted context omitted.

There is apparently a marketing.md file that was deleted 25min ago with the strategy to post on HN. https://github.com/Andyyyy64/whichllm/commit/2cefaea1cc5d2de... I think your hunch is very much spot on. It doesn’t look trustworthy at all.

That’s amazing. Everyone has noticed all of the AI slop projects being posted to Show HN and r/localllama but this is the first time I’m seeing the AI text that is telling people to do this. I was naive enough to think these people had the idea to post the project on their own, but even the idea to post it is coming from the LLMs. Amazing. EDIT: r/selfhosted is in there too. This explains why that subreddit is having…

And it seems to work! First page on HN

Re: Show HN: Find the best local LLM for your hardware, ranked by benchmarks

#65

1. The results of this tool are not good. It’s recommending outdated models like Qwen2.5 series and missing good new models. 2. This could have been a single web page that runs in your browser and lets you enter hardware specs, like all of the other tools like this. It is not a good idea to install and run unknown projects like this on your computer in this age. 3. The project is very obviously vibecoded, down to the…

There is apparently a marketing.md file that was deleted 25min ago with the strategy to post on HN. https://github.com/Andyyyy64/whichllm/commit/2cefaea1cc5d2de... I think your hunch is very much spot on. It doesn’t look trustworthy at all.

Hilariously the commit says "delete marketingmd ai slop".

Re: Show HN: Find the best local LLM for your hardware, ranked by benchmarks

#67

Earlier quoted context omitted.

There is apparently a marketing.md file that was deleted 25min ago with the strategy to post on HN. https://github.com/Andyyyy64/whichllm/commit/2cefaea1cc5d2de... I think your hunch is very much spot on. It doesn’t look trustworthy at all.

That’s amazing. Everyone has noticed all of the AI slop projects being posted to Show HN and r/localllama but this is the first time I’m seeing the AI text that is telling people to do this. I was naive enough to think these people had the idea to post the project on their own, but even the idea to post it is coming from the LLMs. Amazing. EDIT: r/selfhosted is in there too. This explains why that subreddit is having…

/r/selfhosted in particular has gone from a fun community of computing enthusiasts and developers having fun with their software and data on their own terms, to a literal self-promotion wasteland of AI-generated slop.

(And I say this as someone who is not actually against the _intelligent_ use of LLMs for software development.)

Re: Show HN: Find the best local LLM for your hardware, ranked by benchmarks

#68

I love this community, I started building a simple website for this exactly a couple of hours ago and you made an even more advanced version already. Hats off to you sir. If i ever decide to actually publish the site, is it alright if I mention you somewhere as a "If you want a more accurate estimation, check out this project: ", as i think there is value in having a simple website estimate this information for you,…

Read the rest of the comments - your project would still be valued.

Re: Show HN: Find the best local LLM for your hardware, ranked by benchmarks

#70
The premise of "best" makes this a non-starter for me right away. The site says their definition of "best" is 1) fits in RAM 2) has a high benchmark score.

Best for what? All models have their strengths and weaknesses. Controlling for number of parameters, some are better at general knowledge, some are better at writing and planning, some have more creativity, some are better at writing code, some are better at debugging code, etc, et al, and so on.

The "best" model is not "whatever fits into VRAM." You can do lots of useful stuff with a small CPU-only model. Just a few days ago, there was a 29M model optimized for nothing but tool calling.

Last and probably most controversial, the idea that LLM benchmarks scores have any actual real-world value whatsoever is a collective hallucination. They are for marketing and serve no other purpose. New LLMs are always specifically trained to score high on the benchmarks the developers want. Somehow, every new release of every new model _always_ show it scoring slightly above the models it claims are its competitors on most tests. Since LLM output is non-deterministic, you often get wildly different responses to identical prompts, and it is trivial for the developers to cherry-pick results. Since they never show their work, we are expected to take them for their word.

Yes, you need to know if the model will fit into your RAM, and whether the speed will be acceptable. But the _only_ way to know whether a model is suitable for your specific task is to try it out for yourself and see if it does (most of the time) the thing you need it to do.

Post reply on HN