31–40 of 75 posts
Franework is nice but no Nvidia option which is a no-go for LLM.
Thinkpad P1 Gen 6 with RTX 4090 is a solid one. Older generation but Thinkpad seems like no longer slapping top GPU into its notebook.
Other laptops with 4090/5090 are too huge (Titan, Raider, Vector, Strix Scar 18,…)
I’m using Arch on the Thinkpad above.
Hope this helps
Running LLMs on a local mobile device doesn't make sense to me. Sure it sounds great but at what cost & what trade-offs? This goes for laptops & phones.
You can have the best of both worlds by setting up a separate computer in your local network or rent one on the cloud if data privacy & messing around with LLMs is important to you. Then you don't sacrifice the mobile advantage of a great laptop. It'll be cheaper & can be more focused too.
Asus makes a gaming tablet with a 13 inch screen with a 128GB of unified RAM on the new AMD Strix Point. I agree that MacBook is not an option. I have a work MacBook and it has better silicon, ok, but I hate being on a Mac. Just not for me. I'd wait until more manufacturers announce what they will do with that AMD SOC.
You would want a laptop with RTX 4090 or RTX 5090. Anything under 16GB VRAM is going to be too limited for playing around with local LLMs. Franework is nice but no Nvidia option which is a no-go for LLM. Thinkpad P1 Gen 6 with RTX 4090 is a solid one. Older generation but Thinkpad seems like no longer slapping top GPU into its notebook. Other laptops with 4090/5090 are too huge (Titan, Raider, Vector, Strix Scar 18,……
You could buy a MacBook and scratch away the logo, then replace it with a logo of your preferred brand.
Specs aside, this machine can also run Linux well [1], which makes it worth buying, IMO. And if it can run Linux well, then using it for development should be a breeze.
Why is the Macbook not an option? They are the best at making laptop hardware, and to my knowledge you can run what you like on it. Mac OS is good, but I also like Fedora's Atomic distros, such as Bluefin-dx.
I second @jamesliudotcc's suggestion (ASUS ROG Flow Z13). One of the key differentiators vs other laptops is the 128GB unified RAM which runs at 8000 MT/s, which should be excellent for LLMs - I'm not aware of any laptop that can do better, in this form-factor and this level of portability. Specs aside, this machine can also run Linux well [1], which makes it worth buying, IMO. And if it can run Linux well, then usin…