Nvidia on NixOS WSL – Ollama up 24/7 on your gaming PC

Post by borisk » Fri, Apr 11, 2025, 1:21 PM UTC

hu3 wrote: post #36

borisk wrote: post #25

Earlier quoted context omitted.

How is it a waste of money if a lot of people, including the author of the article, already have an nVidia GPU in their PC? Running locally has a lot of advantages - privacy, getting to learn how to run LLMs, not having to deal with quotas, logins, outages.

Home electricity bill of a decent GPU alone is usually more expensive than renting GPUs on demand.

Post by benterix » Fri, Apr 11, 2025, 2:39 PM UTC

neuroelectron wrote: post #31

csdreamer7 wrote: post #29

Earlier quoted context omitted.

^This. People act so helpless to big tech, and especially Windows. Linux is still more effort for normies, but it should not be an issue for most people on this sub to want learn it-you are doing things already on Windows that would not be much different than Linux. AI w/ Nividia alone justifies Linux because Windows has performance issues. Then you have the freedom of leaving Windows if it continues to get hostile.

Brave to assume linux is more secure than Windows. I didn't read the rest of your comment.

Post by skyyler » Fri, Apr 11, 2025, 2:49 PM UTC

tempoponet wrote: post #41

Havoc wrote: post #33

Just did the opposite. Decided it’s time for Linux on desktop. Better for programming. Better for AI. Bet being that I can get most games to work on it - that was the sticking point. (Thanks to Valve I think it’ll work out)

I recently gave this another go, and was pleasantly surprised that I could install Steam easily, the nVidia card was detected and driver installed, and I quickly installed the "Resident Evil 4" remake with awesome performance and no glitchiness Then I rebooted my system and found that Steam had broken Gnome and I couldn't log in and had to go into safe mode and debug from the command line. 1 hour in, 1 thing installe…

Post by rowanG077 » Fri, Apr 11, 2025, 2:56 PM UTC

rad_gruchalski wrote: post #32

csdreamer7 wrote: post #29

Earlier quoted context omitted.

^This. People act so helpless to big tech, and especially Windows. Linux is still more effort for normies, but it should not be an issue for most people on this sub to want learn it-you are doing things already on Windows that would not be much different than Linux. AI w/ Nividia alone justifies Linux because Windows has performance issues. Then you have the freedom of leaving Windows if it continues to get hostile.

Unless you're working for a company where you have no choice. Then you have no freedom to leave Windows. You have, obviously, the freedom to leave your job, but let's be adult.

Post by WD-42 » Fri, Apr 11, 2025, 3:39 PM UTC

tempoponet wrote: post #41

Havoc wrote: post #33

Just did the opposite. Decided it’s time for Linux on desktop. Better for programming. Better for AI. Bet being that I can get most games to work on it - that was the sticking point. (Thanks to Valve I think it’ll work out)

I recently gave this another go, and was pleasantly surprised that I could install Steam easily, the nVidia card was detected and driver installed, and I quickly installed the "Resident Evil 4" remake with awesome performance and no glitchiness Then I rebooted my system and found that Steam had broken Gnome and I couldn't log in and had to go into safe mode and debug from the command line. 1 hour in, 1 thing installe…