Anybody else getting 403 Forbidden error?
25L Portable NV-linked Dual 3090 LLM Rig
31–40 of 126 posts
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#32I built pretty much this exact rig myself, but now it's gathering dust, any other uses for this rather than localLLMS
Play DnD by yourself with Llama as a DM
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#33OK, here's my quick critique of the article (having built a similar AM4-based system in 2023 for 2300€): 1) [I thought] The page is blocking cut & paste. Super annoying! 2) The exact mainboard is not specified exactly. There are 4 different boards called "ASUS ROG Strix X670E Gaming" and some of them only have one PCIe x16 slot. None of them can do PCIe x8 when using two GPUs. 3) The shopping link for the mainboard l…
[flagged]
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#34I’m really interested in this space from an AI sovereignty pov. Is it feasible for SMB/SME to use a box like in the article to get offline analysis of their data? It doesn’t have the worry of sending it off to the cloud. I wanted to speak with businesses in my local area but no one took me up on it.
[deleted]
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#35Earlier quoted context omitted.
I am exploring options just for fun. a used 3090 is around $900 on ebay. a used rtx 6000 ADA is around $5k 4 3090s are slower at inference and worse at training than 1 rtx 6000. 4x3090 would consume 1400W at load. Rtx 6000 would consume 300W at load. If you god forbid live in California and your power averages 45 cents per kwh, 4x3090 would be $1500+ more per year to operate than a single RTX 6000[0] [0] Back of the…
>I am exploring options just for fun. Since you're exploring options just for fun, out of curiosity, would you rent it out whenever you're not using it yourself, so it's not just sitting idle? (Could be noisy and loud). You'd be able to use your computer for other work at the same time and stop whenever you wanted to use it yourself.
It depends. At my electricity cost, 1 hour of 3090 or 1 hour of Rtx 6000 would cost the same 0.45
Just checked vast.ai. I will be losing money with 3090 at my electricity cost and making a tiny bit with rtx 6000.
Like with boats it’s probably better to rent GPUs then buy them
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#36I built pretty much this exact rig myself, but now it's gathering dust, any other uses for this rather than localLLMS
Heating
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#37I'm a huge fan of OpenRouter and their interface for solid LLM's but I recently jumped into fine tuning / modifying my own vision models for FPV drone detection (just for fun) and my daily workstation and it's 2080 just wasn't good enough. Even in 2025 it's cool how solid a setup dual 3090's still are. nvlink is an absolute must but it's incredibly powerful. I'm able to run the latest Mistral thinking models and rela…
I bought a 2nd 3090 2 years ago for like 800eur, still a good price even today I think.
It's in my main workstation, and my idea was to always have Ollama running locally. The problem is that once I have a (large-ish) model running, all my VRAM is almost full and GPU struggles to do things like playing back a YouTube video.
Lately I haven't used local AI much, also because I stopped using any coding AIs (as they wasted more time than they saved), I stopped doing local image generations (the AI image generation hype is going down), and for quick questions I just ask ChatGPT, mostly because I also often use web search and other tools, which are quicker on their platform.
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#38> The workplace of the coworker I built this for is truly offline, with no potential for LAN or wifi, so to download new models and update the system periodically I need to go pick it up from him and take it home.
I'm surprised that a "truly offline" workplace allows servers to be taken home and being connected to the internet.
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#39I just don't get why the RTX 4090 is still so expensive on the used market. New Rtx 5090s are almost as expensive!
“Easy” to mod to 48gb
Re: 25L Portable NV-linked Dual 3090 LLM Rig
#40The link is down with 403 error.