I built a page that tells you what AI model your laptop can run

#1

Post by kumarski » Tue, Jul 21, 2026, 5:08 PM UTC

I built a page that tells you what AI model your laptop can run
localsotabenchmark.engineersf.dev

Re: I built a page that tells you what AI model your laptop can run

#2

Post by kumarski » Tue, Jul 21, 2026, 5:09 PM UTC

and no I'm not a software develpoer - just smacked it together with minimax for personal needs.

Thought it was nifty so shared. Would love to see a real CS person's version of this and/or best prompt to build something like this accurately and keep it up to date as models advance and SOTA shifts.

Re: I built a page that tells you what AI model your laptop can run

#3

Post by cyanydeez » Tue, Jul 21, 2026, 7:08 PM UTC

One word: wrong.

Re: I built a page that tells you what AI model your laptop can run

#4

Post by nailer » Tue, Jul 21, 2026, 7:16 PM UTC

cyanydeez wrote: post #3

One word: wrong.

This isn't constructive feedback. In my case it detected my Mac's capablities accurately and gave me models to use. What was wrong about it?

Re: I built a page that tells you what AI model your laptop can run

#5

Post by nailer » Tue, Jul 21, 2026, 7:19 PM UTC

Great idea! You're 95% of the way there and the rest is a couple of UI tweaks.

1. I thought the table showing a bunch of models after my laptop specs would be models I could run on my laptop.

    Model Tier Example Models Params RAM Needed Your Status
    Top SOTA GPT-4o, Claude 3.5 Sonnet, Gemini Ultra 1T+ Datacenter —
    Large Models Llama 3 70B, Mistral Large, Command R+ 70B 64 GB  Usable
    Mid Models Llama 3 8B, Mistral 7B, Phi-3 Medium 7-13B 16 GB  Usable
    Small Models Phi-3 Mini, Llama 3 2B, Gemma 2B 1-3B 4 GB  Your Tier

'Your tier' is too subtle. I would make 'Your tier' highlight the ENTIRE row in some bright color to make it more obvious, and maybe fade the other rows slightly.

2. I don't know what 'usable' means. How can these models be status:usable if they are not 'my tier'? I deduce 'usable' doesn't mean usable on my laptop but I don't know what 'usable' does mean.

3. Give me links to set up the best model I can.

Re: I built a page that tells you what AI model your laptop can run

#6

Post by kumarski » Tue, Jul 21, 2026, 7:24 PM UTC

nailer wrote: post #5

Great idea! You're 95% of the way there and the rest is a couple of UI tweaks. 1. I thought the table showing a bunch of models after my laptop specs would be models I could run on my laptop. Model Tier Example Models Params RAM Needed Your Status Top SOTA GPT-4o, Claude 3.5 Sonnet, Gemini Ultra 1T+ Datacenter — Large Models Llama 3 70B, Mistral Large, Command R+ 70B 64 GB Usable Mid Models Llama 3 8B, Mistral 7B, Ph…

Thank you G!

Re: I built a page that tells you what AI model your laptop can run

#7

Post by spprashant » Tue, Jul 21, 2026, 7:25 PM UTC

For some reason it is not able to detect 64GB RAM on my Fedora Linux mini PC. It shows only 8GB.

Re: I built a page that tells you what AI model your laptop can run

#8

Post by majormunky » Tue, Jul 21, 2026, 7:26 PM UTC

spprashant wrote: post #7

For some reason it is not able to detect 64GB RAM on my Fedora Linux mini PC. It shows only 8GB.

Yeah, similar situation here, it shows 16gb on my 64gb mac

Re: I built a page that tells you what AI model your laptop can run

#9

Post by not_your_vase » Tue, Jul 21, 2026, 7:31 PM UTC

That's not very accurate. It sees 8 GB RAM instead of 64. And it detects GTX 9 GPU, though I have an RTX30 one.

(Edit: now it came to my mind that Firefox has fingerprinting protection by default. But even after whitelisting this website, the result is the same)

Re: I built a page that tells you what AI model your laptop can run

#10

Post by jsherer » Tue, Jul 21, 2026, 7:39 PM UTC

I find this to be pretty accurate: https://www.canirun.ai/