Live data from Hacker News

25 Gigabit Linux internet router PC build

michael.stapelberg.ch

331–340 of 359 posts

Re: 25 Gigabit Linux internet router PC build

#332

Earlier quoted context omitted.

> For 25 Gb/s Ethernet links, a commercial router is unlikely to be much cheaper or to consume much less than a standard PC. EDIT: I linked to a switch by mistake. This router has 12 x 10G SFP+ and 2 x 25G SFP28 ports and costs $595 It appears to be routing between 13 to 39Gbps depending on the rule complexity. https://mikrotik.com/product/ccr2004_1g_12s_2xs#fndtn-specif...

This is a switch and switching is hardware accelerated. While you can theoretically route with this this, it is incapable of routing at gigabit speeds, let alone 10 gigabit speeds, once you need even a few rules.

Actually that switch has hardware accelerated routing as well with RouterOS 7 IIRC. Take a look at the test results, for large packets that router will still do over 10G throughput with 25 ip filter rules. With no queues or rules it'll do routing just as fast as switching.

Edit: Looks like he changed from the switch to a separate router but look at the change log for the latest R7 release

https://mikrotik.com/download/changelogs/development-release...

>!) added L3 HW support for all CRS3xx devices;

So you get L3 even for this monster. https://mikrotik.com/product/crs326_24s_2q_rm

Re: 25 Gigabit Linux internet router PC build

#333
post #326
post #319

Earlier quoted context omitted.

A lot of fibre is GPON (a type of PON, passive optical network), a scheme where each customer receives data from multiple other customers as well as their own data, so it would be very insecure for them to allow customers to use their own ONT. If you can get AON (active optical networking), then likely they will allow BYO ONT. Note that AON requires more hardware that is more expensive on the ISP side.

Isn't the downstream traffic in GPON encrypted?!

I just looked that up, and you seem to be correct indeed, AES-128 is used.

Re: 25 Gigabit Linux internet router PC build

#334
post #329
post #319

Earlier quoted context omitted.

A lot of fibre is GPON (a type of PON, passive optical network), a scheme where each customer receives data from multiple other customers as well as their own data, so it would be very insecure for them to allow customers to use their own ONT. If you can get AON (active optical networking), then likely they will allow BYO ONT. Note that AON requires more hardware that is more expensive on the ISP side.

In https://twitter.com/kuenzler/status/1397814747379154944 (German), Fredy Künzler from init7 talks about PON and why init7 is opposed to it. He makes the calculation that from the ≈3000 CHF needed to connect a location with fiber, only 50 CHF difference come down to PON or AON. The advantage of dedicated lines (for all ISPs, too!) overweighs the financial savings in his reasoning.

That is a surprisingly small difference, although when you are building a greenfield last-mile fiber network for an entire country that small difference probably adds up to millions, which is probably why we got GPON in Australia.

Re: 25 Gigabit Linux internet router PC build

#335

Earlier quoted context omitted.

The cheap ones (including the one you mentioned) are useless because they have 10Gbase-T. You need SFP+ slots to hook up your provider's fiber. Which is kinda sad too because implementing 10Gbase-T is more expensive to implement and more expensive to run (because the 10Gb-T PHY burns power.) Sadly, there's not enough knowledge about this going around.

yes, well you can get a cheap transceiver for that. You're still going to have to talk to something else and that all goes out the window if you have existing copper in your house or need to have wired devices (NAS, smart TV, xbox, literally anything at all). You probably can't even find a wifi AP that has SFP+ that doesn't cost you 3 arms and 5 legs.

> yes, well you can get a cheap transceiver for that.

Yes, exactly. I feel like you haven't finished your thought ;)

If you have a SFP+ slot, you can plug in a cheap SFP+ 10Gbase-T transceiver. Or a SFP+ fiber transceiver. Or a DAC cable.

If you have a 10Gbase-T port, you're stuck and need to buy and power a switch (or, recently, media converter) to get to anything else. And you're now wasting power for 2 10Gbase-T PHYs that are completely pointless for a very short link.

Of course you'll be using a bunch of 10Gbase-T for anything where you have existing copper runs that are good enough quality to actually run 10Gbase-T. I'm just saying (1) you shouldn't be using 10Gb-T for cabling things that are next to each other, and (2) you shouldn't be running copper cabling for new installations that you're building explicitly to get 10G over.

Re: 25 Gigabit Linux internet router PC build

#336
post #130
post #19

Earlier quoted context omitted.

The machine's clearly massive overkill for routing. Another commenter points out it typically runs around 50w - and the OP says they're also using it as a server in this thread.

Do you know of any smaller scale hardware capable of routing 25Gbit/s?

EOLd mellanox sx6036 switches can be had for $200 on ebay.

Re: 25 Gigabit Linux internet router PC build

#338
post #310
post #141

Earlier quoted context omitted.

Yes we should stop chastising people like that. You have long hair, you use more water, shampoo and drying. You drink coffee how many wh for that cup and its content. We could always find something in others where they consume more. My neighbors keep all their lights on almost all the time in every room. The other one has AC on all day to full power even when it is cooler outside... So complaining that someone uses a…

> My neighbors keep all their lights on almost all the time in every room Almost all the lights in my house are leds, even if I did this the cost would be negligible.

Yeah I think this is a thing of the old days, my father in law is also always on top of light usage. Once I calculated what a 3W led cost him if he let it run the whole year (about 6€) to forget it once in a while is really no reason to get cranky. Leaving a couple of 60W incandescent bulbs on for longer periods can increase a bill indeed, but with leds it’s really not worth being know as the guy that whines about the lights for, IMO.

Re: 25 Gigabit Linux internet router PC build

#339
post #130

Earlier quoted context omitted.

Do you know of any smaller scale hardware capable of routing 25Gbit/s?

EOLd mellanox sx6036 switches can be had for $200 on ebay.

That’s a switch though, not a router OP is building. And I doubt this heavy duty thing uses less power than OPs setup (and we’re taking in a thread complaining about power usage)

Re: 25 Gigabit Linux internet router PC build

#340

Earlier quoted context omitted.

Need a lot more power then that to handle 2x 1GB/s connections.

What? The UDM Pro[0] has a quad-core Cortex A57 CPU running at 1.7GHz, according to the spec sheet I'm looking at right now. It has 4GB of RAM. The ODROID-N2+[1] has a quad-core Cortex A73 CPU running at 2.4GHz. It also has 4GB of RAM. The UDM Pro is like half the performance of the ODROID-N2+, accounting for architecture and frequency differences, so... I'm not sure what you're getting at? The ODROID should be more…

There is far more power in hardware than just the instruction set times the GHZ. Part of the UDM's problem is that there is evidently no offload for needed for PPPoE.

It should also be self-evident, but I also need more the one interface to route traffic to two seperate networks, ignoring that the requirement is actually to load balance multiple systems to a internal 10gb/s network.

The USB is nowhere near what you need to run a 10gb/s or even a 2.5GB/e (based on my experience with other ARM hardware).

Post reply on HN