Live data from Hacker News

25 Gigabit Linux internet router PC build

michael.stapelberg.ch

181–190 of 359 posts

Re: 25 Gigabit Linux internet router PC build

#181

Earlier quoted context omitted.

A RPi is not equivalent to what most would use as a COTS router, which includes a GbE switch and some kind of modem (DSL or cable). The latter on its own needs a few Watts.

On the contrary, OpenWRT and a good CM4-based board allows the Pi to run pretty well as a gigabit router :) https://www.jeffgeerling.com/blog/2021/two-tiny-dual-gigabit...

No CM4 and accompanying carrier board needed . A regular RPi4 with a USB3 gigabit adapter makes for a good gigabit home router. I have been using one as my home gigabit router for the last 14 months without any issues.

Re: 25 Gigabit Linux internet router PC build

#182
post #105

Earlier quoted context omitted.

> In fact this is a nice place to ask: how would you build a "something" that monitors the network for packets sent to powered-off machines, then somehow caches the request, powers the destination machine On, and finally lets the request continue to its target? Has this been tackled anywhere? There must be tons of people wanting a homeserver but living in places where electricity has a considerable cost... IP protoco…

I have built such a gateway for SSH: it accepts the connection, powers on the target machine if needed, then forwards traffic. https://github.com/stapelberg/zkj-nas-tools/blob/master/wolg... The advantage over just catching any packets is that an SSH connection is authorized, so less noisy in terms of undesired wakeups.

Apple has this. It's called Boujour sleep proxy, and it allows a always-on device like a Airport or AppleTV to claim the IP address of a sleeping Mac, waking it with a WoL packet when traffic for that device comes in. It's probably pretty useful, but is annoying on a managed network, as it spams my arpwatch system every time the IP is transferred between devices.

Re: 25 Gigabit Linux internet router PC build

#183
post #165

Earlier quoted context omitted.

SFP requires less energy than RJ45, only 0.7W/port. The MikroTik 4-port CRS305-1G-4S+IN draws 10-18W.

That's not entirely true. SFP power consumption depends on the type of SFP. A 10Gbps DWDM SFP+ might draw 1.8W of power. The why for this is actually quite interesting: the lasers used in DWDM SFPs have much more stringent requirements for temperature stability to ensure the light emitted doesn't drift out of spec. In order to achieve that temperature stability, they use a built in peltier to pump heat away from the…

It would have been fun to be a fly on the wall at Cisco when they first realized people were jamming devices with heaters in SPF sockets.

Re: 25 Gigabit Linux internet router PC build

#184
post #116
post #4

I'm always amazed by people who don't bat an eye on the perspective of having a home server, sucking up electricity 24/7. In this case replacing a typical router (which consumes like a lightbulb), with a full-fledged PC (probably consuming like x100 the power). I guess some people around the world have quite cheap utility bills! For me, it's either a Raspberry Pi type of power consumption, or else a server that only…

I’ve got a handful of computers running in a rack at home. Their total power? Around 400w. I also have a dehumidifier running all the time in the basement. It’s power usage is 500w. No one bats and eye at a heater or dehumidifier, but a computer and people get worried

I agree with your sentiment. It is interesting to look at total power usage and power usage by device. I'm using IotaWatts to monitor every individual circuit in my house (over 200 of them), and it is easy to miss things that add up. With computers it is quite amazing the difference in power load based on cpu/disk load. When I run my PI calculator (which not only pegs CPU, but hits my SAN very hard) I see over a 1kw difference in my homelab power draw.

Re: 25 Gigabit Linux internet router PC build

#185
post #4

I'm always amazed by people who don't bat an eye on the perspective of having a home server, sucking up electricity 24/7. In this case replacing a typical router (which consumes like a lightbulb), with a full-fledged PC (probably consuming like x100 the power). I guess some people around the world have quite cheap utility bills! For me, it's either a Raspberry Pi type of power consumption, or else a server that only…

"probably consuming like x100 the power" is greatly exaggerated. A typical PC might have an idle power consumption of less than 50 W, while a very small computer with ARM little cores might have an idle power of 2 ... 3 W, so at most the power consumption ratio would be 20. However even that is not realistic because a computer or appliance with less than 3 W power consumption will not be able to route 10 Gb/s or fast…

> For 25 Gb/s Ethernet links, a commercial router is unlikely to be much cheaper or to consume much less than a standard PC.

EDIT: I linked to a switch by mistake.

This router has 12 x 10G SFP+ and 2 x 25G SFP28 ports and costs $595

It appears to be routing between 13 to 39Gbps depending on the rule complexity.

https://mikrotik.com/product/ccr2004_1g_12s_2xs#fndtn-specif...

Re: 25 Gigabit Linux internet router PC build

#186
post #38
post #19

Earlier quoted context omitted.

The machine's clearly massive overkill for routing. Another commenter points out it typically runs around 50w - and the OP says they're also using it as a server in this thread.

The problem is running it 24x7, then a small 50w is still 438 Kwh each year. That's more than a 10% increase in yearly use for a typical two person household...

That's very roughly $100/year, which is My workstation bursts to 600w+ for 15-20 minutes at a time when compiling, for comparison.

Re: 25 Gigabit Linux internet router PC build

#187
post #169
post #118

Earlier quoted context omitted.

I have physical switches on or near every outlet. Anything that's not actively being used gets turned off. With the exception of my oven and hob, because those are nearly impossible to reach. I use roughly 2kWh/day. This approach probably doesn't make much sense if you're using an order of magnitude more power. But it makes sense for me.

Crazy. My wife and I used 619 kWh last month

We were at 5MWh last month, so it’s all relative. Don’t feel bad.

Re: 25 Gigabit Linux internet router PC build

#188
post #48

Earlier quoted context omitted.

My home server is about 70W, meaning about 150€ a year (~0.20 eur/kWH). So about 12€ a month. For one of my biggest hobbies. It’s fun, but it also runs WireGuard, 3 NextCloud installs, Home Assistant and Mosquitto, 2 MineCraft servers, a FoundryVTT instance, samba, sabnzbd, Unify Controller, an Nginx static site, LibreSpeed, VaultWarden and soon a Django site. Oh and a virtual desktop (vnc) I can always leave running…

> (~0.20 eur/kWH) Are such high electricity prices common in Europe? That's higher than it is in 49 of the 50 US states (assuming 0.20 EUR = 0.24 USD, and with Hawaii being the exception).

0.30 Euro per kW/h in Germany

Re: 25 Gigabit Linux internet router PC build

#189

Earlier quoted context omitted.

"Zoom call quality was regularly degraded" It sounds like something else was dodgy on your previous network, surely Zoom cannot use up 100mb/s connection

When one side sends data at 1Gb/s and the other receives at 100Mb/s, it's worse than if the first side sent data at 100Mb/s. Here's a description from Julia Evans: https://jvns.ca/blog/2018/07/12/netdev-day-2--moving-away-fr... > Basically my ISP router would receive data at full speed, while internally I would have a lot of dropped packets. Additionally, I usually use the web browser to view Jira or copy files over…

> Basically my ISP router would receive data at full speed, while internally I would have a lot of dropped packets.

This is not how this works. The other end of your zoom call doesn't go "hey the person I'm talking to is on a 700mbits line, so that's how much data I'll send." By that logic you could extend this to the network of your isp, which is probably 10 or 100gbits, so you should have a lot of packet loss where the transition from 10gbits to 700mbits happens. And it's not even clear how the other peer could even know how fast your internet connection is, or the internal network of your ISP. That is what congestion control is for. Your peer can't know your modem's connection speed nor your LAN's speed. Software will simply observe how fast it can send data before packet loss starts to happen. This obviously requires that the there is some sort of feedback by the peer you're talking to. If you're using TCP, the OS will do that for you for free. With UDP, you have to implement that logic yourself in your application. And that's why it doesn't matter where the bottleneck is, it could very well be somewhere "in the middle" between two ISPs.

Re: 25 Gigabit Linux internet router PC build

#190
post #165

Earlier quoted context omitted.

SFP requires less energy than RJ45, only 0.7W/port. The MikroTik 4-port CRS305-1G-4S+IN draws 10-18W.

That's not entirely true. SFP power consumption depends on the type of SFP. A 10Gbps DWDM SFP+ might draw 1.8W of power. The why for this is actually quite interesting: the lasers used in DWDM SFPs have much more stringent requirements for temperature stability to ensure the light emitted doesn't drift out of spec. In order to achieve that temperature stability, they use a built in peltier to pump heat away from the…

Except no one is using DWDM for homelabs, as it's usually used for longer distances. The peltier cooler is definitely cool, though.
Post reply on HN