Live data from Hacker News

25 Gigabit Linux internet router PC build

michael.stapelberg.ch

51–60 of 359 posts

Re: 25 Gigabit Linux internet router PC build

#51
I spent a couple of hours last week trying to set up a fiber connection in our new office. Since I didn't want to use consumer hardware in an office setting (and I already had a router that was compatible), I opted for getting my own hardware (a media converter).

I had _some_ prior knowledge of networking, but had never messed around with VLAN and MTUs before. Luckily I found this[1] gist for a comparable setup that saved me. I'm still only getting 350Mbps where I should be getting 1Gbps, but I _think_ that's just due to the bad networking chip in my cheap chromebook. When I move all my stuff to the office, we'll see what we can top out at...

All this is to say, I definitely respect the effort the author put into this and it pains me to find out that my new SFP setup is already obsolete :).

[1]: https://gist.github.com/Ruben-E/abb9a4a872a7c4ffff058ae291ef...

Re: 25 Gigabit Linux internet router PC build

#52

What is the practical consumer (or even SME) use of a 10 or 25G connection? As a consumer I’d definitely get it for the fun of it, but what is the point in reality? We’ve just launched an ISP a couple of weeks ago here in Europe. Peak bandwidth use is about 3mbps per customer, and customers will download the same amount of data regardless of their plan. I acknowledge this could be lack of imagination on my part, but…

I can't imagine ANY reason that a private household would actually need a 10G or 25G connection unless it's doubling as a workplace and they're hosting servers. Even that seems like a temporary stop-gap situation, get some rackspace in a datacenter already! Maybe they're not selling enough 25G to their business customers and they're trying to get private users onto 25G?

I can see that. Certainly if they already have the infrastructure deployed then a residential usage pattern on 10G is going to look identical to that on 1G (and I’d wager identical to that on 100M in most cases). In which case they can get more recurring revenue for likely only an increased one-off cost.

Re: 25 Gigabit Linux internet router PC build

#53
post #4

I'm always amazed by people who don't bat an eye on the perspective of having a home server, sucking up electricity 24/7. In this case replacing a typical router (which consumes like a lightbulb), with a full-fledged PC (probably consuming like x100 the power). I guess some people around the world have quite cheap utility bills! For me, it's either a Raspberry Pi type of power consumption, or else a server that only…

You can dynamically turn on and off things with MaaS and monitor power though most UPSs.

Re: 25 Gigabit Linux internet router PC build

#55

Earlier quoted context omitted.

Also plenty of slightly more capable laptop class SKUs that are in this ballpark.

Can you still find "desktop" motherboards to go with them? A long time ago, I remember there being desktop MBs for the Pentium M.

For an always running thing, choosing a laptop motherboard is a nice way to guarantee all the power saving features will work properly.

Most desktop motherboards won't allow the PCI express bus to sleep for example, using an extra ~4 watts, $8 per year in eco-friendly countries. Across the ~10 years your NAS will probably sit in a cupboard, that's $80, which isn't an awful lot, but probably would have let you buy a bigger SSD or hard drive which would have had more utility.

Re: 25 Gigabit Linux internet router PC build

#57
post #4

I'm always amazed by people who don't bat an eye on the perspective of having a home server, sucking up electricity 24/7. In this case replacing a typical router (which consumes like a lightbulb), with a full-fledged PC (probably consuming like x100 the power). I guess some people around the world have quite cheap utility bills! For me, it's either a Raspberry Pi type of power consumption, or else a server that only…

let me introduce you to "My PlayHouse" https://www.youtube.com/watch?v=Jhwj_aCEYc0&list=PLS2odYzlao... fun stuff starts at 5:00

Re: 25 Gigabit Linux internet router PC build

#58
post #4

I'm always amazed by people who don't bat an eye on the perspective of having a home server, sucking up electricity 24/7. In this case replacing a typical router (which consumes like a lightbulb), with a full-fledged PC (probably consuming like x100 the power). I guess some people around the world have quite cheap utility bills! For me, it's either a Raspberry Pi type of power consumption, or else a server that only…

I have a computer in a room that’s generally otherwise too cold… so all that power is just useful heat dumped into the room.

Albeit not as efficient as say a heat pump

Re: 25 Gigabit Linux internet router PC build

#59
> I read on many different sites that AMD’s current CPUs beat Intel’s CPUs in terms of performance per watt. We can better achieve goals 2 and 3 (low noise and low power usage) by using fewer watts, so we’ll pick an AMD CPU and mainboard for this build.

Unfortunately many reviews are very misleading here. Zen 2/3 CPUs have good performance per Watt, that's true. But for a machine like this, which will be mostly idle, this is not the interesting metric and Zen 2/3 systems show that you can combine good perf/W with poor idle power consumption (which is not true for their monolithic APU brethren, which are used in laptops).

One of the biggest idle power hogs for these is the IO die, so make sure that XMP is disabled and the memory uses one of the slow JEDEC timings. This should be fine for a router. Check that the SoC/NB voltage is set to 1 V or less. Some boards set this higher. In the AMD CBS section of the board firmware there should be an item "SoC OC Mode" somewhere. Disable it. Some boards allow you to set a new PPT (package power target), but it's worth pointing out that values which are too low will make the CPU very slow because it essentially forces all cores to very low power states in order to meet the PPT since the CPU can't influence the baseline power (due to fabric and I/O die). The upside of using a reasonable PPT of e.g. 50-60 W is that you reduce power consumption if some errant task hogs the CPU.

These settings make a big difference, but only if the CPU is really idle. Even fairly light loads (e.g. on a desktop, moving the mouse on the background) has everything rev up. In deep idle (nothing running at all, no user interaction on a desktop) you might get a Zen 2/3 CPU down to around 20 Watts, but as soon as anything is happening at all we're straight back to the 40-70 W region.

Using an Intel system for this would have likely saved 10-20 W.

Re: 25 Gigabit Linux internet router PC build

#60

What is the practical consumer (or even SME) use of a 10 or 25G connection? As a consumer I’d definitely get it for the fun of it, but what is the point in reality? We’ve just launched an ISP a couple of weeks ago here in Europe. Peak bandwidth use is about 3mbps per customer, and customers will download the same amount of data regardless of their plan. I acknowledge this could be lack of imagination on my part, but…

I have 10G in Tokyo and I think it’s about $60 USD per month vs $40 for 2G. It’s definitely overkill but it sure is nice to download a 60GB steam game in a minute or two.
Post reply on HN