Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: NixOS-DGX-Spark – Nix and NixOS on the DGX Spark

github.com

Post reply on HN
Print view View original

31–40 of 44 posts

Re: Show HN: NixOS-DGX-Spark – Nix and NixOS on the DGX Spark

#31

Post by bergkvist »

dhon_ wrote: post #21
HellsMaddy wrote: post #17

Earlier quoted context omitted.

Absolutely. Running NixOS is a wonderful experience for this reason. NixOS + LLMs make it a breeze to make changes to your system, install and configure new software, and debug issues. Having every aspect of your system defined in a git repo is the perfect fit for agent harnesses. I'll admit, even with LLMs to help, the Nix language and NixOS did have a rather steep learning curve, because it's quite different from a…

You can also push deployments to remote systems which is great for servers and headless devices like raspberry pis. I use colmena and deploy-rs on different projects because they have some nice features but you can also do it with bare nix. I have a repo for kiosk appliances that can build an SD card image for a specific device in a fleet (so no on device configuration is required) but it can also push out updates or…

If you are using an Apple Silicon laptop and you want to deploy to an x86-64 Linux box, this can get a bit annoying due needing to deal with cross compilation in nix.

Re: Show HN: NixOS-DGX-Spark – Nix and NixOS on the DGX Spark

#32

Post by rgoulter »

miki123211 wrote: post #23
hamandcheese wrote: post #11

Slightly off topic, but Claude Code (and likely other models/harnesses) are incredibly effective at Nix. It can trivially self-verify, without side effects, which is a perfect match for an LLM. If you've ever been put off by the difficulty of the language, it's worth checking it out again with AI assistance.

And to add to that, LLMs start with fresh context on each conversation, so they don't have the understanding of your system that human employees do. Nix lets you naturally encode that understanding in code (and in comments), making sure it never drifts from what the state of the system really is. I never saw much point in Nix, but if you put it like that... now I want to try.

Nix (& NixOS) are very much in the same "as code" as Terraform. -- You put in extra effort now, to save effort later.

This isn't traditionally 'practical'. It's quicker to just install the package, compared to writing a declaration that says to make the package available. (And for ops, Docker images won out in terms of practicality).

Nix also quite a steep learning curve.. I expect a beginner just wants to learn how to write a package in Nix, and not learn about 'derivations', 'instantiation', etc.

Interesting to see LLM coding agents adjust that trade-off: significantly reducing the cost to "write something in Nix", so the benefits become much cheaper.

Re: Show HN: NixOS-DGX-Spark – Nix and NixOS on the DGX Spark

#33

Post by arikrahman »

hamandcheese wrote: post #11

Slightly off topic, but Claude Code (and likely other models/harnesses) are incredibly effective at Nix. It can trivially self-verify, without side effects, which is a perfect match for an LLM. If you've ever been put off by the difficulty of the language, it's worth checking it out again with AI assistance.

Likewise, I don't know where my dotfiles would be without deepseek/reasonix model configuring my entire OS for almust free with cache hits.

Re: Show HN: NixOS-DGX-Spark – Nix and NixOS on the DGX Spark

#34

Post by reasonabl_human »

thenobsta wrote: post #6

This is incredible. I have a Jetson lying around and will try to it out on this. I use it to play with vision models, not LLMs, and have been wanting a better way to manage the machine.

you probably want this if you have a jetson vs this spark repo:

https://github.com/anduril/jetpack-nixos

Re: Show HN: NixOS-DGX-Spark – Nix and NixOS on the DGX Spark

#35

Post by reinitctxoffset »

reinitctxoffset wrote: post #30
pixelesque wrote: post #15

Earlier quoted context omitted.

Thanks - yeah, sorry, I mis-read that as you using both DS and K3...

I'm doing K3 with SoL kernels, zero hassle, myelin to sweep up the crap, on shot deploy to vast or runpods. Free to the community. I have to do like, low paying web dev to fund it, so I can't promise timelines, but it's coming and it will be free to anyone and fast as fuck. I estimate about 20 bucks an hour at current spot rates in the hundreds if not thousands of tokens per second.

@pg @dang

you're asking me how a watch works. let's just try to keep an eye on the time.

federal felony prosecution.

Re: Show HN: NixOS-DGX-Spark – Nix and NixOS on the DGX Spark

#36

Post by graham33 »

bergkvist wrote: post #31
dhon_ wrote: post #21

Earlier quoted context omitted.

You can also push deployments to remote systems which is great for servers and headless devices like raspberry pis. I use colmena and deploy-rs on different projects because they have some nice features but you can also do it with bare nix. I have a repo for kiosk appliances that can build an SD card image for a specific device in a fleet (so no on device configuration is required) but it can also push out updates or…

If you are using an Apple Silicon laptop and you want to deploy to an x86-64 Linux box, this can get a bit annoying due needing to deal with cross compilation in nix.

You can have an x86-64 remote builder, or use a service like nixbuild.net, rather than use cross-compilation.

Re: Show HN: NixOS-DGX-Spark – Nix and NixOS on the DGX Spark

#37

Post by lobofta »

HellsMaddy wrote: post #17
hamandcheese wrote: post #11

Slightly off topic, but Claude Code (and likely other models/harnesses) are incredibly effective at Nix. It can trivially self-verify, without side effects, which is a perfect match for an LLM. If you've ever been put off by the difficulty of the language, it's worth checking it out again with AI assistance.

Absolutely. Running NixOS is a wonderful experience for this reason. NixOS + LLMs make it a breeze to make changes to your system, install and configure new software, and debug issues. Having every aspect of your system defined in a git repo is the perfect fit for agent harnesses. I'll admit, even with LLMs to help, the Nix language and NixOS did have a rather steep learning curve, because it's quite different from a…

Seconded. I always have a workspace on my NixOs where I can query an LLM to fix anything I don't like about my OS.

9 out 10 times it gets it right on the first shot and my OS is at that point slightly better for the rest of eternity (unless I stop running NixOs, which I don't see happening any time soon). About 2 years of these incremental changes, and some investments on my own part about what tools I really like, has made my OS an absolute joy and breeze to work with.

Nothing compares. It's like having a version of Omarchy, not build by some other dude to fit their world view, but for yourself that co-evolves with your own preferences and tools.

Re: Show HN: NixOS-DGX-Spark – Nix and NixOS on the DGX Spark

#38

Post by neobrain »

redrove wrote: post #4

Been running this on a few Asus GX10 machines with k3s on top, it’s been great. I’m running the new deepseek. Thank you for your work!

Just curious, has suspend (to RAM) been working for you?

For me the nvidia driver just keeps waking up the system instantly - but my setup is deviating from the upstream flake in a few ways, so I'm just wondering if it's worth setting up the system from scratch if it's working for other people.

Other than that, can fully second that the flake is working great. Only gotcha is that CUDA-enabled packages (including Firefox) require using the flox binary cache unless you want to compile them from source, but then the package versions can lag behind a bit (and debugging nix cache issues is surprisingly difficult).

Re: Show HN: NixOS-DGX-Spark – Nix and NixOS on the DGX Spark

#39

Post by jbstack »

rgoulter wrote: post #32
miki123211 wrote: post #23

Earlier quoted context omitted.

And to add to that, LLMs start with fresh context on each conversation, so they don't have the understanding of your system that human employees do. Nix lets you naturally encode that understanding in code (and in comments), making sure it never drifts from what the state of the system really is. I never saw much point in Nix, but if you put it like that... now I want to try.

Nix (& NixOS) are very much in the same "as code" as Terraform. -- You put in extra effort now, to save effort later. This isn't traditionally 'practical'. It's quicker to just install the package, compared to writing a declaration that says to make the package available. (And for ops, Docker images won out in terms of practicality). Nix also quite a steep learning curve.. I expect a beginner just wants to learn how…

It's true that the Nix language is quite difficult to learn. However, part of that is the poor documentation, and the weird situation where flakes are the de facto modern way of doing things, but are still treated as an "experimental" feature (which leads to further confusion when reading documentation based on the old way of doing things).

Luckily LLMs can help with this too. I asked ChatGPT to generate a course with just enough content to help an ordinary NixOS user configure their system, work with Nix code and flakes, and create/modify simple packages (which is rarely needed anyway). Just a few hours of that gave me a much stronger understanding than all the documentation / tutorials I had read before.

Re: Show HN: NixOS-DGX-Spark – Nix and NixOS on the DGX Spark

#40

Post by redrove »

reinitctxoffset wrote: post #25
redrove wrote: post #4

Been running this on a few Asus GX10 machines with k3s on top, it’s been great. I’m running the new deepseek. Thank you for your work!

i also used nixos as the base, but i went a little overboard with it, this is 7.1.2 supporting all devices and a custom driver that fixes the UMA page leak issues, and the wallpapers are all kernels at or above parity with what you can get out of the box. i'm not quite ready to OSS the whole thing, it's got a few rough edges, but if anyone wants to alpha test, caveat emptor and it's yours. https://www.youtube.com/sho…

I’d be happy to test this out if you want to publish an alpha branch or something.
Post reply on HN