Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

25 Gbit/s at home, part 1

boredengineer.medium.com

Post reply on HN
Print view View original

31–40 of 154 posts

Re: 25 Gbit/s at home, part 1

#31

Post by tgtweak »

Phelinofist wrote: post #24
tgtweak wrote: post #20

Recently moved up to 3gbps bidirectional and had a hell of a time getting 3gbps even with 10gbps network card directly into the 10gbps port on the ISP-provided modem. In addition to this, there are very few services that will actually feed you data at 3gbps. Steam - ~280MB/s (2.2gbps) Battle.net launcher - ~140MB/s (1.1gbps) 25GB Torrent with 1000+ seeders - ~70MB/s (~560mbps) 2GB iso from github - ~80MB/s (~650mbps)…

280MB/s steam? On a good day I get 25MB/s (Vodafone 400/25) on any German mirror

Your max theoretical would be 50MB/s on that connection, so 25MB is not terrible. I think there is some notable overhead on steam (check summing or encryption) as with my 1gbps connection previously I would never get past 100MB/s (800mbps).

Re: 25 Gbit/s at home, part 1

#32

Post by chaxor »

ricw wrote: post #3
hinkley wrote: post #2

What is the state of the art in leveraging your home network to have a presence (website or otherwise) on the internet? Fiber just became available in our neighborhood recently and I'm about to have fewer people sharing our network, so the idea of being able to host my own files is becoming attractive again. We are about to be due for this pendulum (centralized vs distributed) to swing back again and I like to be pre…

As long as you have a static IP address, this is trivial and typically very reliable. Throw an ATS battery into the mix and the internet will be super reliant, even when the power goes down. Am doing this at home with a fibre line and it's been super reliable.

Dynamic dns is a thing?

Re: 25 Gbit/s at home, part 1

#33

Post by zamadatix »

tgtweak wrote: post #20

Recently moved up to 3gbps bidirectional and had a hell of a time getting 3gbps even with 10gbps network card directly into the 10gbps port on the ISP-provided modem. In addition to this, there are very few services that will actually feed you data at 3gbps. Steam - ~280MB/s (2.2gbps) Battle.net launcher - ~140MB/s (1.1gbps) 25GB Torrent with 1000+ seeders - ~70MB/s (~560mbps) 2GB iso from github - ~80MB/s (~650mbps)…

On 5/5 I've found Usenet obliterates torrenting in the throughput department.

Re: 25 Gbit/s at home, part 1

#34

Post by formerly_proven »

tgtweak wrote: post #20

Recently moved up to 3gbps bidirectional and had a hell of a time getting 3gbps even with 10gbps network card directly into the 10gbps port on the ISP-provided modem. In addition to this, there are very few services that will actually feed you data at 3gbps. Steam - ~280MB/s (2.2gbps) Battle.net launcher - ~140MB/s (1.1gbps) 25GB Torrent with 1000+ seeders - ~70MB/s (~560mbps) 2GB iso from github - ~80MB/s (~650mbps)…

Steam downloads are always very CPU intensive for me, it seems to need about 1 core per 100 megabit/s. I'm guessing they're using somewhat slow compression, perhaps LZMA. Likewise, game file validation is CPU limited (it only uses a single thread) at around 500 MB/s for me. Probably an outdated algorithm choice as well.

Re: 25 Gbit/s at home, part 1

#35

Post by nickspacek »

hinkley wrote: post #2

What is the state of the art in leveraging your home network to have a presence (website or otherwise) on the internet? Fiber just became available in our neighborhood recently and I'm about to have fewer people sharing our network, so the idea of being able to host my own files is becoming attractive again. We are about to be due for this pendulum (centralized vs distributed) to swing back again and I like to be pre…

I don't want to open my home network to just anybody, so I have a "jumpbox" that is the lowest-end shared VM at Hetzner. It runs nginx, dnsmasq, and Wireguard; my home servers connect to it, I add other peers as I need to, and dnsmasq resolves the hostnames using Zeroguard IPs for the home network.

I have 3 sets of DNS entries for the home lab servers:

1. "internal"/home network addresses (e.g. your 192.168.x.x) 2. Wireguard addresses (e.g. 10.0.x.x) 3. public DNS entries that all resolve to the jumpbox

The purpose of #3 is to support simple Letsencrypt setup: nginx on jumpbox forwards Letsencrypt requests to the internal servers over the Wireguard connection.

Internally, I use a https://github.com/nginx-proxy/nginx-proxy setup, so that any time I want a new service running inside the home lab I just have to:

1. Pick a hostname and add it to public DNS 2. Configure its Docker container to add the environment variables that nginx-proxy looks for 3. Add the hostname to the jumpbox /etc/hosts 4. Add the hostname to internal LAN DNS

It's a little much but I like how it works. It's not so bad to get setup.

Re: 25 Gbit/s at home, part 1

#36

Post by ivan4th »

> The top shows that single-core performance is the bottleneck, and all CPU is consumed by ksoftirqd.

Trying out VPP instead of Linux kernel networking might make some sense: https://fd.io

It will likely reach the target performance, although the NIC requirements need to be rechecked.

But... well, this software is not for the faint of heart ;)

Re: 25 Gbit/s at home, part 1

#37

Post by rconti »

candiddevmike wrote: post #11
rconti wrote: post #8

Earlier quoted context omitted.

I think the pendulum DID swing, as The Cloud became more popular and connections became radically asymmetric with very slow upload.

10 Mbps upload is plenty fast for hosting things like websites and web apps.

10Mbps is barely enough to send the ACKs on a 250Mbps download. Maybe it's fine as a dedicated connection, but you might not want to be hosting anything on your home connection.

Re: 25 Gbit/s at home, part 1

#38

Post by tgtweak »

zamadatix wrote: post #25

For home runs I'd recommend using duplex instead of simplex (the cable out to the provider has to stay to whatever they require of course). For a 100M cable it's $37.47 for the duplex and $24.48 for the simplex, the price difference of $13 for a really long run. The price difference of 2x 25BASE-LR (duplex) vs 2x 25BASE-BX (simplex) transceivers will be more like $60. Even if you want to stick with simplex optics eve…

The price of 25GbaseT (rj45) is still very high. 10GbaseT (rj45) is coming down very nicely though and some motherboards, routers and high end access points have 10g ports onboard. I think it's actually cheaper to go 40gbps QSFP and run MPO cables (4 pairs internally) than it is to go 25g fiber. This is pretty much the case in datacenter right now for anything that doesn't need to go over 300M.

Re: 25 Gbit/s at home, part 1

#39

Post by saiya-jin »

tgtweak wrote: post #20

Recently moved up to 3gbps bidirectional and had a hell of a time getting 3gbps even with 10gbps network card directly into the 10gbps port on the ISP-provided modem. In addition to this, there are very few services that will actually feed you data at 3gbps. Steam - ~280MB/s (2.2gbps) Battle.net launcher - ~140MB/s (1.1gbps) 25GB Torrent with 1000+ seeders - ~70MB/s (~560mbps) 2GB iso from github - ~80MB/s (~650mbps)…

Unless you are say say pro competitive gamer (lag) or doing sone fringe science, anything above 1gbs real speed is useless these days.

I have it, or slightly below, with pings around 7ms, and... as a regular user with some modest 10tb movies and games collection, 99% of the cases 100mbit is more than fine, and the rest covers rest.

No place for anxious ocd types, but low ping and overall reliability of the connection are way more important to me, even for fetching 70gb+ games. Not only due to wfh, but also for that.

Re: 25 Gbit/s at home, part 1

#40

Post by tgtweak »

zamadatix wrote: post #33
tgtweak wrote: post #20

Recently moved up to 3gbps bidirectional and had a hell of a time getting 3gbps even with 10gbps network card directly into the 10gbps port on the ISP-provided modem. In addition to this, there are very few services that will actually feed you data at 3gbps. Steam - ~280MB/s (2.2gbps) Battle.net launcher - ~140MB/s (1.1gbps) 25GB Torrent with 1000+ seeders - ~70MB/s (~560mbps) 2GB iso from github - ~80MB/s (~650mbps)…

On 5/5 I've found Usenet obliterates torrenting in the throughput department.

Yeah but you pay for UseNet access separately. Some usenet servers charge extra for access over 100mbps or 1gbps.
Post reply on HN