Live data from Hacker News

25 Gbit/s at home, part 1

boredengineer.medium.com

91–100 of 154 posts

Re: 25 Gbit/s at home, part 1

#91

I can upgrade from 1Gbit to 10Gbit for only 5 euros extra per month but I don't really have anything to take advantage of it. I don't think my new MacBook Air M2 even supports 6E, and wiring the apartment would be a bit of a hassle.

With the size of recent games and patches, 1 Gbit starts to feel a bit too low. :)

And about Macbook... In my current setup, I'm using Thunderbolt -> PCIe and one of the Mellanox cards; it gives excellent and stable 16 Gbps with stock firmware and DriverKit-based drivers (that comes with OSX), though it feels that DriverKit driver doesn't use any offloading that it supports (while running iperf between Macbook and router, it consumes roughly 3 cores entirely on Macbook, while the router doesn't even ramp up the single core to its boost frequency).

But you are right; rewiring is a hassle, though Cat5e usually works with 10Gbit over reasonable lengths (10-30 meters, maybe a bit more if it is perfect quality cable).

Also, even if I decided not to go for fibre, I'd still switch to at least 10Gbps because I'm not alone in that network :)

Re: 25 Gbit/s at home, part 1

#92
post #20

Recently moved up to 3gbps bidirectional and had a hell of a time getting 3gbps even with 10gbps network card directly into the 10gbps port on the ISP-provided modem. In addition to this, there are very few services that will actually feed you data at 3gbps. Steam - ~280MB/s (2.2gbps) Battle.net launcher - ~140MB/s (1.1gbps) 25GB Torrent with 1000+ seeders - ~70MB/s (~560mbps) 2GB iso from github - ~80MB/s (~650mbps)…

I just upgraded to 10GbE service from Ziply Fiber in the Seattle area: Speedtest.net - ~9.3Gbps symmetric iperf to Denver: ~9.3Gbps symmetric (~8 threads) iperf to Minneapolis: ~9.3Gbps symmetric AWS S3 Download with small files: 1.3Gbps Usenet download: 7-9.5Gbps Mounting my ZFS pool to an AWS instance via SMBv3 in us-west-2: 3Gbps (not clear what the limit was here) GitHub (400MB): 1 thread 400Mbps, 16 threads: 3.3…

[deleted]

Re: 25 Gbit/s at home, part 1

#93

Earlier quoted context omitted.

What Ubiquiti equipment are you using? Doesn’t their router top out at 3.5Gbps?

UDM Pro USW-Pro-Aggregation USW-Pro-48-PoE US-XG-6PoE Recently bypassed AT&T's residential gateway by getting a XGS-PON on a SFP+ stick, let me shave off 2ms and gain a couple hundred mbps each way, in addition to removing their crappy gateway.

Which stick did you go with?

Re: 25 Gbit/s at home, part 1

#94
post #20

Recently moved up to 3gbps bidirectional and had a hell of a time getting 3gbps even with 10gbps network card directly into the 10gbps port on the ISP-provided modem. In addition to this, there are very few services that will actually feed you data at 3gbps. Steam - ~280MB/s (2.2gbps) Battle.net launcher - ~140MB/s (1.1gbps) 25GB Torrent with 1000+ seeders - ~70MB/s (~560mbps) 2GB iso from github - ~80MB/s (~650mbps)…

280MB/s steam? On a good day I get 25MB/s (Vodafone 400/25) on any German mirror

I get about the same; full link speed at 2Gbit. Steam will absolutely chew CPU to support this

I see a notable difference on a 7950X3D simply by messing around with the power/performance governors.

Re: 25 Gbit/s at home, part 1

#96

If you want to know more about init7s network and how they can provide 25gbits see this presentation they did https://youtu.be/wXmJCzMeIBo

After reading your article, I've started to think if I want to get myself a splicer :D Before, I felt that field connectors would work just fine and splices were too expensive...

Re: 25 Gbit/s at home, part 1

#97
I get about 200Mb/s on my 1Gb/s connection because my office is at the other side of the house to the router so I use mesh WiFi. Given that all my walls are solid brick, that's not too bad, really.

Re: 25 Gbit/s at home, part 1

#98
post #20

Recently moved up to 3gbps bidirectional and had a hell of a time getting 3gbps even with 10gbps network card directly into the 10gbps port on the ISP-provided modem. In addition to this, there are very few services that will actually feed you data at 3gbps. Steam - ~280MB/s (2.2gbps) Battle.net launcher - ~140MB/s (1.1gbps) 25GB Torrent with 1000+ seeders - ~70MB/s (~560mbps) 2GB iso from github - ~80MB/s (~650mbps)…

I just upgraded to 10GbE service from Ziply Fiber in the Seattle area: Speedtest.net - ~9.3Gbps symmetric iperf to Denver: ~9.3Gbps symmetric (~8 threads) iperf to Minneapolis: ~9.3Gbps symmetric AWS S3 Download with small files: 1.3Gbps Usenet download: 7-9.5Gbps Mounting my ZFS pool to an AWS instance via SMBv3 in us-west-2: 3Gbps (not clear what the limit was here) GitHub (400MB): 1 thread 400Mbps, 16 threads: 3.3…

AWS S3 Download with small files: 1.3Gbps

That's $53/h in data transfer costs from us-west-2... (They are so absurd.)

Re: 25 Gbit/s at home, part 1

#99
post #54

These kinds of speeds are available in Switzerland because their laws state that any fiber laid down must be usable by competitors, so that ISPs must compete on service alone. I wish we had that in other countries as well.

But then who pays for laying down the fiber? What company would want to pay that cost when others can use it?

Here in New Zealand the tax payer contracted a lines company to do it. ISPs compete on service but we don’t get 25 - maybe 4 or 8Gbps.

Re: 25 Gbit/s at home, part 1

#100

This seems like a bonkers solution to be putting packets through a 150w CPU, especially with the price of electrity in Switzerland.

I still need to measure and optimise power consumption correctly, but it drew about 70W from the socket during the tests, according to my simple power meter. CPU never ran at boost frequency, and a lot of other stuff is in a low power state.
Post reply on HN