Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

25 Gigabit Linux internet router PC build

michael.stapelberg.ch

Post reply on HN
Print view View original

251–260 of 359 posts

Re: 25 Gigabit Linux internet router PC build

#251

Post by walrus01 »

nixgeek wrote: post #228
Bud wrote: post #220

The real story here is how great the internet service can be now in a civilized country if you don't let Comcast have monopolies and ban local internet cooperatives and coast along selling the same service for 15 years while raising prices. 25Gbps symmetric for about $70/month. That's significantly less than I pay Comcast for its crappy 900Mbps down/40Mbps up service.

At least in PNW the service isn’t 900/40 any more, it’s advertised as “1.2Gbps” and the profile actually seems to be 20% over that, I’ve seen 1.5Gbps or 170-180MB/sec downstream performance recently. Upstream is still <= 50Mbps and otherwise agree with your comment that the U.S. is falling behind in price-throughput on domestic internet services versus many other developed nations.

Upstream on cable like that will be sub 50 Mbps because they're very intentionally only using a small number of rf channels on the coax for upstream. This is why in my opinion docsis3 is putting lipstick on a pig and is only a short term stop gap solution. The better end state is proper SM fiber to each house.

Re: 25 Gigabit Linux internet router PC build

#252

Post by sydney6 »

To get a grip around the numbers, i quote from George Neville-Neil's Talk at BSDCan '15 "Measure Twice, Code Once" [1]:

- 10 Gbps is 14.8 million 64 byte packets per second - 67.5 ns per packet or 200 cycles at 3 GHz - Cache miss is 32 ns

[1] https://www.youtube.com/watch?v=LE4wMsP7zeA

Re: 25 Gigabit Linux internet router PC build

#253

Post by ju-st »

Mave83 wrote: post #159

why no just buy a good nvidia/mellanox nic and route directly on it? Modern NIC's are amazing and you can offload everything if you like.

but it is only offloaded to some ARM cores and not done in hardware? can they really route and NAT 25gbit? and the manuals for connectx-5 or nvidia bluefield don't even mention ipv6?

Re: 25 Gigabit Linux internet router PC build

#254

Post by deckard1 »

tyingq wrote: post #111
sliken wrote: post #8

Was hoping for similar but 10 gbit. Anyone know a nice small/quiet linux box with 2x10 gbit for use as a router? I have a 8 port x 1gbit ubiquiti router, but ubiquiti seems to be going downhill, and 8 port x 10gbit routers are pretty expensive. My plan was a 2 port router and use vlan tagging to a 8+ port 10g switch. That way I can have separate networks for trusted ethernet, trusted wifi, untrusted ethernet, and unt…

I would go with a used SuperMicro A1SAI-2750F motherboard. It comes with an Atom 8-core C2750 (20w TDP) and a single 8 lane PCIe slot, but doesn't need active cooling. Supports ECC ram too. There's a passive heatsink on the CPU that works fine. I believe that would keep up with 2x10gb, be quiet, and power efficient. They are $200 or so used on eBay. So not terribly expensive for something that can push 10g. And it wi…

I'd probably go with SuperMicro X10SDV-4C-TLN2F. It already has 10GbE.

   Xeon D-1521
   2x 10GbE ports onboard
   6x SATA3 ports
   Accepts ECC RDIMM DDR4 (usually cheaper than UDIMM ECC)
   1x PCIe 3.0 x16
   1x M.2 slot
There is one on ebay right now for $230 USD shipped.

Also, if you're going for lower power consumption I believe you can disable the IPMI and the 2nd 10GbE port if you don't need it. There are other ways to reduce consumption too. Turn off anything you can on the motherboard that you don't use and use higher density DIMM sticks (and less of them, if you can, e.g. 1x16GB rather than 2x8GB). Also worth paying attention to the PSU's efficiency curve and making sure your PSU is decent quality (reliable + 80+ gold).

Re: 25 Gigabit Linux internet router PC build

#256

Post by n3dm »

johnwalkr wrote: post #60
adamcharnock wrote: post #17

What is the practical consumer (or even SME) use of a 10 or 25G connection? As a consumer I’d definitely get it for the fun of it, but what is the point in reality? We’ve just launched an ISP a couple of weeks ago here in Europe. Peak bandwidth use is about 3mbps per customer, and customers will download the same amount of data regardless of their plan. I acknowledge this could be lack of imagination on my part, but…

I have 10G in Tokyo and I think it’s about $60 USD per month vs $40 for 2G. It’s definitely overkill but it sure is nice to download a 60GB steam game in a minute or two.

This hardly is relevant to your internet speeds with steam downloads. It is much more CPU dependent when you are operating at such high speeds.

Re: 25 Gigabit Linux internet router PC build

#257

Post by nixgeek »

wormslayer666 wrote: post #237
nixgeek wrote: post #228

Earlier quoted context omitted.

At least in PNW the service isn’t 900/40 any more, it’s advertised as “1.2Gbps” and the profile actually seems to be 20% over that, I’ve seen 1.5Gbps or 170-180MB/sec downstream performance recently. Upstream is still <= 50Mbps and otherwise agree with your comment that the U.S. is falling behind in price-throughput on domestic internet services versus many other developed nations.

There have always been regional variations in this; I've had the same 1.2GBps plan in a few states now and it only ever got close to that number in the one where Fios was an option. Comcast's only innovation in the last few years has been to add data caps to residential fiber service (my 300mb/s "1.2 GBps" is capped at 1.4TB/mo).

We’ve just been paying a $30/mo upcharge for unlimited data (removal of overage charges). Basically because it’s more predictable than the $10 for every 50GB overages. A few months we’ve had 4-5TB through the service and Comcast doesn’t seem to have slowed us down or charged more.

Re: 25 Gigabit Linux internet router PC build

#258

Post by labawi »

JCharante wrote: post #163
t0mas88 wrote: post #38

Earlier quoted context omitted.

The problem is running it 24x7, then a small 50w is still 438 Kwh each year. That's more than a 10% increase in yearly use for a typical two person household...

Aren't 60w lightbulbs still around?

Do you run your lightbulbs 24/7?

If so, you should get a LED alternative.

Re: 25 Gigabit Linux internet router PC build

#259

Post by hda111 »

RKearney wrote: post #240
Bud wrote: post #220

The real story here is how great the internet service can be now in a civilized country if you don't let Comcast have monopolies and ban local internet cooperatives and coast along selling the same service for 15 years while raising prices. 25Gbps symmetric for about $70/month. That's significantly less than I pay Comcast for its crappy 900Mbps down/40Mbps up service.

I'm sure the fact that Germany has a 566% larger population density and is 96.19% smaller than the United States has a lot to do with a countries ability to bring 25Gbps internet to its citizens.

Internet in Germany is really bad and expensive compared to Switzerland and even to the rest of Europe. In Germany fiber to the home is maybe 1-2% of all internet connections. Most fiber providers in Germany offer only artificial asymmetric connections and are very expensive.

Re: 25 Gigabit Linux internet router PC build

#260

Post by e12e »

yakubin wrote: post #72
adamcharnock wrote: post #17

What is the practical consumer (or even SME) use of a 10 or 25G connection? As a consumer I’d definitely get it for the fun of it, but what is the point in reality? We’ve just launched an ISP a couple of weeks ago here in Europe. Peak bandwidth use is about 3mbps per customer, and customers will download the same amount of data regardless of their plan. I acknowledge this could be lack of imagination on my part, but…

I work from home and regularly need to download large files from work servers. Several months ago I noticed that my internal network was 100Mb/s, which was dreadful. Downloads of 500MiB files would take tens of minutes, because Tomcat would drop connections on such a slow download. And even without dropped connections it generally took a long time to download anything, and Zoom call quality was regularly degraded (I…

> I noticed that my internal network was 100Mb/s, which was dreadful. Downloads of 500MiB files would take tens of minutes, because Tomcat would drop connections on such a slow download. And even without dropped connections it generally took a long time to download anything, and Zoom call quality was regularly degraded.

Was you network setup broken? Did your firewall block ICMP? Ancient servers like tomcat and apache should handle slow networks in stride, even with modern updates - and 500MB at 100mbps is 40 seconds?

Now I can't imagine running 100mbps today for a home network... So upgrading makes sense. But your problems doesn't sound like they were caused by your lan speed.

Post reply on HN