Live data from Hacker News

25 Gigabit Linux internet router PC build

michael.stapelberg.ch

271–280 of 359 posts

Re: 25 Gigabit Linux internet router PC build

#271

Earlier quoted context omitted.

At least in PNW the service isn’t 900/40 any more, it’s advertised as “1.2Gbps” and the profile actually seems to be 20% over that, I’ve seen 1.5Gbps or 170-180MB/sec downstream performance recently. Upstream is still <= 50Mbps and otherwise agree with your comment that the U.S. is falling behind in price-throughput on domestic internet services versus many other developed nations.

There have always been regional variations in this; I've had the same 1.2GBps plan in a few states now and it only ever got close to that number in the one where Fios was an option. Comcast's only innovation in the last few years has been to add data caps to residential fiber service (my 300mb/s "1.2 GBps" is capped at 1.4TB/mo).

Let's please not further the idea that it's acceptable to quote only downstream speed when citing Internet speeds.

Doing that just leads to 20 more years of Comcast killing the concept of modern Internet service for Americans. Cite both numbers.

Re: 25 Gigabit Linux internet router PC build

#272
post #206

I have a Unifi UDMP, which while I think is probably the best prosumer option right now, falls way short due to a PPPoE problem that limits fiber connections to under 500mb/s, and the lack of load balancing across multiple link networks (which I totally admit, is a first world problem). I am thinking about building my own, but then comes the maintaince of all of the hardware / software. For me that would be fine, but…

Can you link or elaborate more on this PPPoE problem? i have a UDMP on the way, and I don't think I'll be affected by it with my simple network design, but also not sure.

PPPoE de-encapuslation is likely not hardware accelerated (or can't be combined with other hardware accelerated packet processing) or if that platform is more PC like than I thought, it may be that the PPPoE de-encapsulation is single threaded either as a missed software feature or because the nic can't separate it into multiple queues.

PPPoE is one of the worst network protocols ever, and there's no reason it should have been implemented on fiber. I don't really understand why it was implemented on DSL either; maybe some bizarro way to try to prevent theft of service?

Re: 25 Gigabit Linux internet router PC build

#273
post #261

Earlier quoted context omitted.

We have a couple fiber companies in our town (USA), and we have been shopping for internet. Currently we have fiber from AT&T. One is over a mile down the road and they want $90,000 to connect and then $1750 a month for 1gbps. Another company is two blocks away, they will only charge $8,000 to connect and it’s $1,550 a month for the same speed. Problem is there aren’t many other companies in the area that want servic…

I'm in New Zealand, a small island nation. I have 1gbps for around $70 USD per month. The install was free. I get a VoIP phone and Prime video subscription included. Most of my devices are wireless so I really don't take advantage of the speed.

I pay about 17 USD for 1 Gbps in Europe.

Re: 25 Gigabit Linux internet router PC build

#274

Earlier quoted context omitted.

> For 25 Gb/s Ethernet links, a commercial router is unlikely to be much cheaper or to consume much less than a standard PC. EDIT: I linked to a switch by mistake. This router has 12 x 10G SFP+ and 2 x 25G SFP28 ports and costs $595 It appears to be routing between 13 to 39Gbps depending on the rule complexity. https://mikrotik.com/product/ccr2004_1g_12s_2xs#fndtn-specif...

This is a switch and switching is hardware accelerated. While you can theoretically route with this this, it is incapable of routing at gigabit speeds, let alone 10 gigabit speeds, once you need even a few rules.

[deleted]

Re: 25 Gigabit Linux internet router PC build

#275
post #220

The real story here is how great the internet service can be now in a civilized country if you don't let Comcast have monopolies and ban local internet cooperatives and coast along selling the same service for 15 years while raising prices. 25Gbps symmetric for about $70/month. That's significantly less than I pay Comcast for its crappy 900Mbps down/40Mbps up service.

The primary reason the cost for init7 is so low is that for example in Zürich city the fiber network is owned by the city (like water pipes and power lines) and paid for by the tax payer. Any provider can provide their service over it. Places outside the city that don't have these kinds of fiber connections aren't this lucky.

Yes and no. Local ISPs in the U.S. are also laying/stringing their own fiber and providing cheap (cheaper than shown here) service. They are starting to move into 10/25 gigabit speeds too, as the costly part (running the fiber) doesn't do much to limit the speed, you just have to update the equipment at each end.

Re: 25 Gigabit Linux internet router PC build

#276
post #261

Earlier quoted context omitted.

I'm in New Zealand, a small island nation. I have 1gbps for around $70 USD per month. The install was free. I get a VoIP phone and Prime video subscription included. Most of my devices are wireless so I really don't take advantage of the speed.

Which ISP are you with?

2 Degree's. They bundled it all with my cell plan.

Re: 25 Gigabit Linux internet router PC build

#277

Earlier quoted context omitted.

I have a computer in a room that’s generally otherwise too cold… so all that power is just useful heat dumped into the room.

Albeit not as efficient as say a heat pump

That depends. The heat might be used in a heat pump for all we know.

Re: 25 Gigabit Linux internet router PC build

#278
post #220

The real story here is how great the internet service can be now in a civilized country if you don't let Comcast have monopolies and ban local internet cooperatives and coast along selling the same service for 15 years while raising prices. 25Gbps symmetric for about $70/month. That's significantly less than I pay Comcast for its crappy 900Mbps down/40Mbps up service.

The primary reason the cost for init7 is so low is that for example in Zürich city the fiber network is owned by the city (like water pipes and power lines) and paid for by the tax payer. Any provider can provide their service over it. Places outside the city that don't have these kinds of fiber connections aren't this lucky.

There are a number of county sized public utilities districts in Washington state which are doing essentially the same thing. These particular ones are also the last mile electrical grid operator connected to some of the big hydroelectric dams in the region.

Re: 25 Gigabit Linux internet router PC build

#279
post #165

Earlier quoted context omitted.

That's not entirely true. SFP power consumption depends on the type of SFP. A 10Gbps DWDM SFP+ might draw 1.8W of power. The why for this is actually quite interesting: the lasers used in DWDM SFPs have much more stringent requirements for temperature stability to ensure the light emitted doesn't drift out of spec. In order to achieve that temperature stability, they use a built in peltier to pump heat away from the…

It would have been fun to be a fly on the wall at Cisco when they first realized people were jamming devices with heaters in SPF sockets.

Cisco didn't "realize" this was happening, they specified, had manufactured, and sold the very SFPs the GP post is describing. SFP slots in routers are designed with this thermal load in mind.

Which is also why plugging a large amount of DWDM optics into a datacenter switch is a bad idea. Datacenter switches are _not_ designed with this in mind. You run into risks of both overheating the switch as well as overloading the PSUs. A small number of high-power optics ain't gonna break the switch though.

And: 10Gbase-T SFPs have horrendous power consumption, even worse than DWDM SFPs. At these speeds, the signal over copper is mostly mush, and the PHY contains a none-too-trivial analog & digital signal processor. Which, again, is where limitations for 10Gbase-T SFP usage come from. If at all possible, avoid this shit — there's absolutely no reason to have 10Gbase-T inside a rack, for example. Just use DAC cables or SR optics.

Re: 25 Gigabit Linux internet router PC build

#280

Earlier quoted context omitted.

> MikroTik 4-port CRS305-1G-4S+IN I have two of these at home, they're neat little bits of kit. They're fanless and therefore silent, which is fine until you realise you want to do 10GbE over existing copper cables with something like Mikrotik's S+RJ10 adapter. Then the temps start to rise... So, I've decided to go completely to fibre, even if it means opening up the walls of the house. Just bought a job lot of used…

How do you obtain custom lengths of fibre cables that work with ConnectX-3?

The ConnectX-3 cards are not vendor locked in any way. (And even if they were, that'd only affect the SFP, not the cable.)
Post reply on HN