Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

25 Gbit/s at home, part 1

boredengineer.medium.com

Post reply on HN
Print view View original

101–110 of 154 posts

Re: 25 Gbit/s at home, part 1

#101

Post by zamadatix »

avidiax wrote: post #85
zamadatix wrote: post #43

Earlier quoted context omitted.

You do need to pay but I would stay away from any provider still charging more based on how much bandwidth or transfer you're using, they are likely just extremely outdated or plain overpriced not actually better. Frugal Usenet for $50/y is where I'd point anyone but there are tons of good alternatives too so that's not the only place people should check out by any means. I've pulled about 50 TB in the last 2 months…

Is there a modern guide to UseNet that you'd recommend?

I followed the guide here https://www.reddit.com/r/usenet/wiki/index/. I ended up doing Frugal for the provider, nzbgeek for the indexer, and nzbget for the client. Mapping to torrent terms the indexer is the torrent search site, the client is the client, and the provider is (effectively, in this mapping) who you pay to leech from. Depending how deep you get into it it may be worthwhile to look at a second provider on a different backbone (for greater availability) and/or another indexer but I'd start with just that and see how it works for you then add if needed.

Config wise signing up a provider is like buying anything else online. Setting up the client isn't much more difficult than setting up a torrent client (select default folders, set limits, etc) beyond you need to manually enter the info to connect to the providers.

Re: 25 Gbit/s at home, part 1

#102

Post by abwizz »

Phelinofist wrote: post #24
tgtweak wrote: post #20

Recently moved up to 3gbps bidirectional and had a hell of a time getting 3gbps even with 10gbps network card directly into the 10gbps port on the ISP-provided modem. In addition to this, there are very few services that will actually feed you data at 3gbps. Steam - ~280MB/s (2.2gbps) Battle.net launcher - ~140MB/s (1.1gbps) 25GB Torrent with 1000+ seeders - ~70MB/s (~560mbps) 2GB iso from github - ~80MB/s (~650mbps)…

280MB/s steam? On a good day I get 25MB/s (Vodafone 400/25) on any German mirror

cable is shared media

Re: 25 Gbit/s at home, part 1

#103

Post by e40 »

I have 10Gbps via Sonic.net and n Unifi UDM SE. I don't have 10Gbps internally, though, but the speed test on the UDM SE got about 3.5Gbps. I get 900+Mbps internally and torrents can do about 80-90MB/s. It is glorious.

An interesting note about the torrenting: I was shocked that my Mac Mini (Intel) running 12.$latest absolutely could not keep up with more than 20MB/s. The network stack just broke and the machine would actually stop responding to pings.

I moved it to a Linux box and ran Transmission (same software) in a container and it is where the 80-90MB/s numbers came from. Doesn't phase the box it's running on.

Seriously disappointed in the Apple networking stack.

Re: 25 Gbit/s at home, part 1

#104

Post by woooooo »

_gabe_ wrote: post #88
masterteague3 wrote: post #57

Earlier quoted context omitted.

To convert MB/s to gb/s (MegaBytes per second to Gigabits per second) simply multiply by 8 (8 bits per byte). So 280MB/s is 2.24gbps (moving the decimal place).

> but I always multiply transfers times 10 to estimate bandwidth, since there is some overhead in the TCP/IP protocol

20%ish seems high though, especially for file transfers which are probably almost all full packets near 1500 MTU cross WAN.

Re: 25 Gbit/s at home, part 1

#105

Post by bitsandboots »

As an enthusiast but not an expert nor a person with unlimited time and money, I found that while hitting 1gb/s LAN on ethernet is easy, moving up to 10gb/s has been hard. I have 2 networking cards and a router in between them, all 10gb capable. Yet, it's really hard to get them to do that. I started with reliably getting 2.5gb/s and managed to move up to 5gb/s through some tweaks, but actually getting the full value of the hardware seems hard. The bottleneck could be anywhere as far as I know, and I don't have the hardware to swap out in experiments. I don't think it's a drive bottleneck, but even then its not clear.

So, I'm all for faster, but it seems faster comes with some headaches if you don't know what you're doing. It's just surprising that consumers are still pretty much limited to 1gb/s after all these years, and my attempt to do otherwise hasn't fully paid off yet.

Re: 25 Gbit/s at home, part 1

#106

Post by civiloid »

ivan4th wrote: post #36

> The top shows that single-core performance is the bottleneck, and all CPU is consumed by ksoftirqd. Trying out VPP instead of Linux kernel networking might make some sense: https://fd.io It will likely reach the target performance, although the NIC requirements need to be rechecked. But... well, this software is not for the faint of heart ;)

Well... I did more than I've described in the post (I'm the article's author). It just became too large, so I've decided to stop and publish a second part once I run more tests and fix some problems.

So far, I have yet to figure out all the problems and settings with Netronome (or give up on it). Still, it is Netronome-specific as I can easily get line rate over TCP single stream with Mellanox cards, and the CPU doesn't even break a sweat (however, I have relatively simple routing rules).

I want to try out programmable NIC, and as far as I understand, Netronome has some support there; I just wanted to get a simple setup running first and then optimise/improve it. I tend to perfect the setup, and if I let myself do more and more and more - I will always need more time to finish it.

Re: 25 Gbit/s at home, part 1

#107

Post by gottorf »

candiddevmike wrote: post #87
nirav72 wrote: post #82

Earlier quoted context omitted.

Regarding the money aspects of the high cost of entry - you can source cheap hardware from secondary markets. I just helped a friend setup a cheap selfhosting/homelab for his home. He bought couple of HP EliteDesk 800 G4 minis for $99/each with i5-8500T CPUs. Each came with 16gb ram. Both units had NVMe drives. So we just had to add couple of 2.5 SSDs 2tb ($50/each) for media storage. Running Ubuntu server with CasaO…

Where'd you find those, ebay? That sounds like a great deal.

Not the GP, but eBay is great for off-lease or just plain old computer equipment.

Re: 25 Gbit/s at home, part 1

#108

Post by zamadatix »

thcthc wrote: post #89
masterteague3 wrote: post #57

Earlier quoted context omitted.

To convert MB/s to gb/s (MegaBytes per second to Gigabits per second) simply multiply by 8 (8 bits per byte). So 280MB/s is 2.24gbps (moving the decimal place).

There is another variable as well. Most network equipment I've worked with reported throughput with incorrectly labeled kibi/mibi/gibi, and the ISP uses kilo/mega/giga. The former system is multiples of 1024, the latter the mathematical and legal definition of x1000 The X10 rule of thumb is probably pretty spot on at the end

What godforsaken gear reports in binary prefixes? That's just... horrendous.

Re: 25 Gbit/s at home, part 1

#110

Post by Phelinofist »

tgtweak wrote: post #31
Phelinofist wrote: post #24

Earlier quoted context omitted.

280MB/s steam? On a good day I get 25MB/s (Vodafone 400/25) on any German mirror

Your max theoretical would be 50MB/s on that connection, so 25MB is not terrible. I think there is some notable overhead on steam (check summing or encryption) as with my 1gbps connection previously I would never get past 100MB/s (800mbps).

I regularly max out at 70MB/s for other services, so the connection is actually pretty good IMHO
Post reply on HN