Live data from Hacker News

25 Gigabit Linux internet router PC build

michael.stapelberg.ch

241–250 of 359 posts

Re: 25 Gigabit Linux internet router PC build

#241

Kind of surprised there wasn't much attention paid to the software. My understanding is that with stuff like DPDK and fd.io you can get much better performance without going to extremes with your hardware. Netgate TNSR is one product that puts all the opensource pieces together to make it easy but it is all opensource software so should be usable by the average home user.

With a Xeon, a SmartNIC, and DPDK you can hit 100 Gbps.

Re: 25 Gigabit Linux internet router PC build

#242

Earlier quoted context omitted.

> MikroTik 4-port CRS305-1G-4S+IN I have two of these at home, they're neat little bits of kit. They're fanless and therefore silent, which is fine until you realise you want to do 10GbE over existing copper cables with something like Mikrotik's S+RJ10 adapter. Then the temps start to rise... So, I've decided to go completely to fibre, even if it means opening up the walls of the house. Just bought a job lot of used…

How do you obtain custom lengths of fibre cables that work with ConnectX-3?

Use fs.com, their generic cables work with MikroTik no issue and they do custom orders.

Re: 25 Gigabit Linux internet router PC build

#243

I have a Unifi UDMP, which while I think is probably the best prosumer option right now, falls way short due to a PPPoE problem that limits fiber connections to under 500mb/s, and the lack of load balancing across multiple link networks (which I totally admit, is a first world problem). I am thinking about building my own, but then comes the maintaince of all of the hardware / software. For me that would be fine, but…

> falls way short due to a PPPoE problem that limits fiber connections to under 500mb/s, and the lack of load balancing across multiple link networks (which I totally admit, is a first world problem). how are you achieving load balancing? using LACP? not having working LACP seems kind of unacceptable in my opinion for suchs an expensive device. Also, older enterprise grade routing hardware can be had for very cheap.

It has a failover over the two WAN ports, but no load balancing at all across them.

Re: 25 Gigabit Linux internet router PC build

#244
post #206

I have a Unifi UDMP, which while I think is probably the best prosumer option right now, falls way short due to a PPPoE problem that limits fiber connections to under 500mb/s, and the lack of load balancing across multiple link networks (which I totally admit, is a first world problem). I am thinking about building my own, but then comes the maintaince of all of the hardware / software. For me that would be fine, but…

Can you link or elaborate more on this PPPoE problem? i have a UDMP on the way, and I don't think I'll be affected by it with my simple network design, but also not sure.

It's determined by your WAN provider. Centurylink and google, (AFAIK) leverage PPPoE connections, and the network traffic there seems to be limited around 600mb/s.

I replaced the connection with a cable drop, which I get 1.2gb/s down on.

Re: 25 Gigabit Linux internet router PC build

#245
post #220

The real story here is how great the internet service can be now in a civilized country if you don't let Comcast have monopolies and ban local internet cooperatives and coast along selling the same service for 15 years while raising prices. 25Gbps symmetric for about $70/month. That's significantly less than I pay Comcast for its crappy 900Mbps down/40Mbps up service.

Solving the last mile facilities based isp problem in detached houses in the USA and Canada is a hard one. In most places with aerial Telecom and power infrastructure, you will have three things coming to a house. Electricity, obviously. And then whatever is the local phone company, and the local incumbent cable TV company.

If you're unlucky enough to live in a place where the phone company is operating old degraded DSL on copper phone lines, and doesn't care to overbuild it with single mode fiber for GPON, and the cable TV company is also something similarly large and slightly evil like Comcast, you're almost out of luck. This is a political and regulatory problem that allows the local franchise agreement for the phone company and cable tv company to be renewed in perpetuity without demanding solid metrics for improvement of service.

If you are very fortunate, there will be an entirely single mode fiber-based third-party provider which competes with the previous two mentioned things. Doing what's called and "overbuild" as a new entrant for this is very capital intensive and requires a lot of physical outside plant cabling work and infrastructure at layer 1 in the OSI model. It also requires appropriate cooperation from whichever local entity owns and controls the wood utility poles (again, a political problem).

Re: 25 Gigabit Linux internet router PC build

#246
post #5

Earlier quoted context omitted.

There is a middle ground - either an Intel Atom or Intel Celeron based server - typically use around 10w and you still get niceties like SATA and even PCIe

If you are OK with external USB drives, I did just that with my Atomic PI [1] (Atom-based, 35$ SBC, 3.5W idle, running Debian on its internal EMMC, with two external USB drivers in ZFS-mirror configuration). [1] https://www.thanassis.space/atomicpi.html

You can also get rackmount servers in 1U format with Atom CPU's that support 4 3.5" drives, e.g. https://www.broadberry.co.uk/intel-atom-rackmount-servers/cy...

Re: 25 Gigabit Linux internet router PC build

#247
post #157

Earlier quoted context omitted.

I run just plex and pi hole. Money I save with plex that I don’t need a million different services and having no ads at home is well worth the price. One day my friends went out and I couldn’t go. They got all drunk and shared how much they rely on my plex and by the time I woke up I had close to $1k in PayPal and a note that said “for an upgrade and your time” so honestly I probably making out on the deal. Went from…

I've been looking at the offers of big providers and the average seems to be pretty much standard: 2 TB for $10/month. All across Dropbox, Google, Apple, even Microsoft (the individual plan) are in the same ballpark.

I’ve read that it costs them $2 to store a single TB a month. Which makes sense. $4 -> $10 is a reasonable markup. I store 80 TB for $20. They lose money on me.

Re: 25 Gigabit Linux internet router PC build

#248
I really respect this build, the only thing that I don’t like is the power consumption at idle of ~50 Watt. I understand that this is probably due to the used NICs but still.

It might almost be interesting to setup a second router (a Pi4 might do) for regular casual internet usage + VRRP and only turn on this beast when more bandwidth is required.

The 25Gbit machine would be the VRRP master and the Pi4 the slave.

Re: 25 Gigabit Linux internet router PC build

#249
post #203

I have a Unifi UDMP, which while I think is probably the best prosumer option right now, falls way short due to a PPPoE problem that limits fiber connections to under 500mb/s, and the lack of load balancing across multiple link networks (which I totally admit, is a first world problem). I am thinking about building my own, but then comes the maintaince of all of the hardware / software. For me that would be fine, but…

Odroid N2?

Need a lot more power then that to handle 2x 1GB/s connections.

Re: 25 Gigabit Linux internet router PC build

#250
post #220

The real story here is how great the internet service can be now in a civilized country if you don't let Comcast have monopolies and ban local internet cooperatives and coast along selling the same service for 15 years while raising prices. 25Gbps symmetric for about $70/month. That's significantly less than I pay Comcast for its crappy 900Mbps down/40Mbps up service.

I'm sure the fact that Germany has a 566% larger population density and is 96.19% smaller than the United States has a lot to do with a countries ability to bring 25Gbps internet to its citizens.

>I'm sure the fact that Germany

Sorry to disappoint you, but it not Sweden or Germany but Switzerland...Germany has bad internet too, but hey that mistake happens even to the best ones (like Bush Junior)

Post reply on HN