Live data from Hacker News

25 Gigabit Linux internet router PC build

michael.stapelberg.ch

341–350 of 359 posts

Re: 25 Gigabit Linux internet router PC build

#341

Earlier quoted context omitted.

I can't imagine ANY reason that a private household would actually need a 10G or 25G connection unless it's doubling as a workplace and they're hosting servers. Even that seems like a temporary stop-gap situation, get some rackspace in a datacenter already! Maybe they're not selling enough 25G to their business customers and they're trying to get private users onto 25G?

For download? Working from home with large media assets of any sort. For upload? Yes, I need ANYTHING faster than Comcast's BS so I can actually do any work OR even backups without killing my ability to do other things.

Right, that's totally reasonable, it sounds like you need an SLA (service level agreement) from you ISP, like a business-class service at 1G up/down.

Bu can you really make use of 25G or 10G service to the point where 1G is unacceptably slow? Probably not. It would strongly depend on the bandwidth of whatever you're connecting to.

As a deluxe nice-to-have with bragging rights, sure, but it won't make an operational difference except in very specific scenarios that almost no household would actually need.

Re: 25 Gigabit Linux internet router PC build

#342

Earlier quoted context omitted.

It would have been fun to be a fly on the wall at Cisco when they first realized people were jamming devices with heaters in SPF sockets.

Cisco didn't "realize" this was happening, they specified, had manufactured, and sold the very SFPs the GP post is describing. SFP slots in routers are designed with this thermal load in mind. Which is also why plugging a large amount of DWDM optics into a datacenter switch is a bad idea. Datacenter switches are _not_ designed with this in mind. You run into risks of both overheating the switch as well as overloading…

I'm being a bit glib, but from the point of view of someone who used SFP optics once in a while, it seemed like the whole "standard" was a bit of a mess.

If it was known that vendors would try to push their thermals past what the device cage would support, why not address that better?

The general impression I was given is that thermal loads were one of the primary reasons given for vendor-locking pluggable optics, and that the original SFP spec didn't even address it.

Re: 25 Gigabit Linux internet router PC build

#343
post #332

Earlier quoted context omitted.

This is a switch and switching is hardware accelerated. While you can theoretically route with this this, it is incapable of routing at gigabit speeds, let alone 10 gigabit speeds, once you need even a few rules.

Actually that switch has hardware accelerated routing as well with RouterOS 7 IIRC. Take a look at the test results, for large packets that router will still do over 10G throughput with 25 ip filter rules. With no queues or rules it'll do routing just as fast as switching. Edit: Looks like he changed from the switch to a separate router but look at the change log for the latest R7 release https://mikrotik.com/downloa…

Interesting. I had only looked at RouterOS 6. I have had trouble with mikrotik software before though. (I have a CSS 610 and a lot of its core features were completely broken before)

Re: 25 Gigabit Linux internet router PC build

#344

Earlier quoted context omitted.

Does Google check or care what is on there? That would make me nervous.

I use encfs. Big scary warning on Ubuntu when you install it that it’s not 100% fool proof but for storing tv and movies in the cloud I think it’s fine. Best part is it’s totally seemless on my end. Uploads encrypted and my view is unencrypted.

bwahahaha, so they can't even hash similar common files and save the storage across users.

Re: 25 Gigabit Linux internet router PC build

#345
post #24
post #20

One thing I've run into when building my own 10gbps router that I didn't see mentioned - you probably need to disable power saving / frequency scaling. The handling of packets is done in software, so when you start a download and the flood of initial data comes in at 10gbps, your CPU will still be running at 600 MHz and unable to keep up. It ramps up within 5-50 milliseconds depending on CPU, but for a TCP download t…

In none of my tests did I need to change power saving settings. My iperf3 transfers stayed at 10 Gbps throughout.

You won't see the impact because you're testing over something with very low latency.

Re: 25 Gigabit Linux internet router PC build

#346

What is the practical consumer (or even SME) use of a 10 or 25G connection? As a consumer I’d definitely get it for the fun of it, but what is the point in reality? We’ve just launched an ISP a couple of weeks ago here in Europe. Peak bandwidth use is about 3mbps per customer, and customers will download the same amount of data regardless of their plan. I acknowledge this could be lack of imagination on my part, but…

I have 10G in Tokyo and I think it’s about $60 USD per month vs $40 for 2G. It’s definitely overkill but it sure is nice to download a 60GB steam game in a minute or two.

What do you use for a router? I've got 10G (price difference from 1G was even less percentage then yours) internet myself but currently just use an RB4110 as router which is the primary bottle neck. Would be nice with something reasonably priced and sized which can route 10G or close to 10G with NAT so I could utilize my uplink a bit more.

Re: 25 Gigabit Linux internet router PC build

#347
post #72

What is the practical consumer (or even SME) use of a 10 or 25G connection? As a consumer I’d definitely get it for the fun of it, but what is the point in reality? We’ve just launched an ISP a couple of weeks ago here in Europe. Peak bandwidth use is about 3mbps per customer, and customers will download the same amount of data regardless of their plan. I acknowledge this could be lack of imagination on my part, but…

I work from home and regularly need to download large files from work servers. Several months ago I noticed that my internal network was 100Mb/s, which was dreadful. Downloads of 500MiB files would take tens of minutes, because Tomcat would drop connections on such a slow download. And even without dropped connections it generally took a long time to download anything, and Zoom call quality was regularly degraded (I…

In my case it was either 1G or 10G (no in-between), price difference between 1 and 10 wasn't huge, most of the cost was installing the actual fibre optics in the house.

Re: 25 Gigabit Linux internet router PC build

#348
post #339

Earlier quoted context omitted.

EOLd mellanox sx6036 switches can be had for $200 on ebay.

That’s a switch though, not a router OP is building. And I doubt this heavy duty thing uses less power than OPs setup (and we’re taking in a thread complaining about power usage)

I agree. that it uses (relatively) lots of power (and is very noisy). but a managed switch might serve the guys router needs as well. depends what hes trying to do. Most people using a "router" inside the home, can probably get away with a managed switch. But another question was cost, so was trying to address that.

Re: 25 Gigabit Linux internet router PC build

#349
post #310

Earlier quoted context omitted.

> My neighbors keep all their lights on almost all the time in every room Almost all the lights in my house are leds, even if I did this the cost would be negligible.

Yeah I think this is a thing of the old days, my father in law is also always on top of light usage. Once I calculated what a 3W led cost him if he let it run the whole year (about 6€) to forget it once in a while is really no reason to get cranky. Leaving a couple of 60W incandescent bulbs on for longer periods can increase a bill indeed, but with leds it’s really not worth being know as the guy that whines about th…

I don’t really think it’s about cost for these people. There’s something about a needlessly glowing lightbulb that is just offensive to them.

Re: 25 Gigabit Linux internet router PC build

#350
@secure: I'm a fan and love what you did with router7, gokrazy and your homelab. Note that this might be seen as "How I replaced my off-the-shelf 600CHF router with a 1700CHF custom PC router".

I hope you'll update this once Fiber7 updates their POP to show measured performance :-)

Post reply on HN