25L Portable NV-linked Dual 3090 LLM Rig
reddit.com
25L Portable NV-linked Dual 3090 LLM Rig
1–10 of 126 posts
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#2I'm a huge fan of OpenRouter and their interface for solid LLM's but I recently jumped into fine tuning / modifying my own vision models for FPV drone detection (just for fun) and my daily workstation and it's 2080 just wasn't good enough.
Even in 2025 it's cool how solid a setup dual 3090's still are. nvlink is an absolute must but it's incredibly powerful. I'm able to run the latest Mistral thinking models and relatively powerful yolo based VLM's like the ones RoboFlow is based on.
Curious if anyone else is still using 3090's or has feedback for scaling up to 4-6 3090s.
Thanks everyone ;)
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#3total cost?
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#4I'm a huge fan of OpenRouter and their interface for solid LLM's but I recently jumped into fine tuning / modifying my own vision models for FPV drone detection (just for fun) and my daily workstation and it's 2080 just wasn't good enough. Even in 2025 it's cool how solid a setup dual 3090's still are. nvlink is an absolute must but it's incredibly powerful. I'm able to run the latest Mistral thinking models and rela…
[deleted]
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#5total cost?
It's written quite large on the page, just over 3K
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#6I just don't get why the RTX 4090 is still so expensive on the used market. New Rtx 5090s are almost as expensive!
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#7I just don't get why the RTX 4090 is still so expensive on the used market. New Rtx 5090s are almost as expensive!
They're dropping. I'm trying to offload 8x 4090s and I'll average $1500 I think.
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#8total cost?
It says $3090 (maybe easy to miss since it also talks about RTX 3090s?)
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#9I'm a huge fan of OpenRouter and their interface for solid LLM's but I recently jumped into fine tuning / modifying my own vision models for FPV drone detection (just for fun) and my daily workstation and it's 2080 just wasn't good enough. Even in 2025 it's cool how solid a setup dual 3090's still are. nvlink is an absolute must but it's incredibly powerful. I'm able to run the latest Mistral thinking models and rela…
if it's just for detection would audio not be cheaper to process?
I'm imagining a cluster of directional microphones, and then i don't know if it's better to perform some sort of band pass filtering first since it's so computationally cheap or whether it's better to just feed everything into the model directly. No idea.
I guess my first thought was just sounds from a drone likely is detectable reliably at a greater distance than visual, they're so small and a 180 degree by 180 degree hemisphere of pixels is a lot to process.
Fun problem either wayway.
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#10I'm a huge fan of OpenRouter and their interface for solid LLM's but I recently jumped into fine tuning / modifying my own vision models for FPV drone detection (just for fun) and my daily workstation and it's 2080 just wasn't good enough. Even in 2025 it's cool how solid a setup dual 3090's still are. nvlink is an absolute must but it's incredibly powerful. I'm able to run the latest Mistral thinking models and rela…
The 3090 are a sweet spot for training. It’s the first generation with seriously fast VRAM. And it’s the last generation before Nvidia blocked NVlink. If you need to copy parameters between GPUs during training, the 3090 can be up to 70% faster than 4090 or 5090. Because the latter two are limited by PCI express bandwidth.