Live data from Hacker News

Building a 25 Gbit/s workstation for the SCION Association

github.com

21–30 of 34 posts

Re: Building a 25 Gbit/s workstation for the SCION Association

#21
post #15

Earlier quoted context omitted.

My understanding is that the setup needs to allow them to work on packet routing at those speeds, not just send/receive, to simulate SCION.

Ah, so they need to hold giant routing tables in memory and do lookups in them or something like that?

Does not look like it [1]. It appears to be a protocol that enumerates your exact path, interface by interface, on every data packet. So you can just blindly forward to the next hop written in the packet itself.

By my guess, a competent and efficient implementation should be able to run the routing logic at ~30-100 million packets per second per core. That would be ~300-1,000 Gb/s per core, so you would bottleneck on your memory bandwidth if you have even a single copy.

[1] https://www.ietf.org/archive/id/draft-dekater-scion-dataplan...

Re: Building a 25 Gbit/s workstation for the SCION Association

#22
post #18
post #17

Earlier quoted context omitted.

Huh?

"SCION OSS border router performance reached a ceiling of around 400k-500k packets per second, which is roughly equivalent to 5-6 Gbit/s at a 1500-byte MTU." vs. 1.4 M PPS for IP (on an older CPU) https://toonk.io/linux-kernel-and-measuring-network-throughp...

Ah. Thanks!

Re: Building a 25 Gbit/s workstation for the SCION Association

#23
post #21
post #15

Earlier quoted context omitted.

Ah, so they need to hold giant routing tables in memory and do lookups in them or something like that?

Does not look like it [1]. It appears to be a protocol that enumerates your exact path, interface by interface, on every data packet. So you can just blindly forward to the next hop written in the packet itself. By my guess, a competent and efficient implementation should be able to run the routing logic at ~30-100 million packets per second per core. That would be ~300-1,000 Gb/s per core, so you would bottleneck on…

Don't forget checking the MACs.

Re: Building a 25 Gbit/s workstation for the SCION Association

#27
post #21
post #15

Earlier quoted context omitted.

Ah, so they need to hold giant routing tables in memory and do lookups in them or something like that?

Does not look like it [1]. It appears to be a protocol that enumerates your exact path, interface by interface, on every data packet. So you can just blindly forward to the next hop written in the packet itself. By my guess, a competent and efficient implementation should be able to run the routing logic at ~30-100 million packets per second per core. That would be ~300-1,000 Gb/s per core, so you would bottleneck on…

Is this some MPLS-like thing?

Re: Building a 25 Gbit/s workstation for the SCION Association

#28
post #16
post #4

Wow, 249 CHF for 8x fans is insane. The grip Noctua has on people! Nice workstation.

Noctua makes really good fans, I'm told. Want to get on their level and make a similar amount of money? In a world of slop, quality engineering is valuable.

There fans are still good, but not the quietest anymore.

Noctua no longer manufactures them, they are now made by YS Tech.

Re: Building a 25 Gbit/s workstation for the SCION Association

#29
post #11

I have 25Gbps from Init7 at home. My "router" is a Minisforum MS-01 with a second-hand Mellanox ConnectX-5, running VyOS. My main home server is a Supermicro SYS-510D-4C-FN6P. It has dual 25Gbps ports onboard but also an Intel E810-XXVDA4T with another 4x25Gbps ports. Both of them are perfectly capable of saturating their ports using stock forwarding on Linux, no DPDK, VPP, anything, without breaking a sweat. Both of…

Your MS-01 routes line-rate 25Gbps in software with VyOS w/o kernel bypass? That's very surprising to me. At what packet sizes?
Post reply on HN