Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Add 10 GbE to your system with an M.2 2280 module

cnx-software.com

Post reply on HN
Print view View original

71–80 of 259 posts

Re: Add 10 GbE to your system with an M.2 2280 module

#71

Post by tblt »

ThePadawan wrote: post #33
vardump wrote: post #17

Earlier quoted context omitted.

Getting stuck to 1 Gbps is somewhat crazy, as even the slowest laptop and PC M.2 SSDs can do 10-20 Gbps easy. Fastest ones 50 Gbps+. But I guess most people don't transfer files in their local networks anymore and use their network purely for internet access.

I rent an apartment in a building that was erected around 2015. They laid an ethernet connection... with a 100Mbps bandwidth limit. Some people just don't care.

They may have done this to run a single cable to supply both data and telephony/door intercom etc on the other pairs. I agree it's not ideal.

Re: Add 10 GbE to your system with an M.2 2280 module

#72

Post by xroche »

loosescrews wrote: post #5

I have had a lot of trouble with the Marvell AQtion controllers under Linux. They are supposed to work and are plug and play on modern kernels, but I was never able to resolve a bug where the controller stopped working after a few hours. The only resolution I found was rebooting, which made the controller not very useful. The Intel 10GbE controllers are more expensive, but much better in my experience. For anyone loo…

Same experience with a bunch of Aquantia AQC-107 (ASUS XG-C100C). Had to remove them from a Linux server, it just won't work and botch IPv6 traffic (especially routing advertisement notices ?!). Got Intel x550t2 and all the issues miraculously disappeared.

Re: Add 10 GbE to your system with an M.2 2280 module

#73

Post by tomohawk »

dtech wrote: post #64
AnthonyMouse wrote: post #20

Earlier quoted context omitted.

It's kind of chicken and egg. It's not worth buying a 10G switch when all or nearly all of your devices are gigabit and it's not worth buying 10G cards for any device when you have a gigabit switch. What you need for the transition is for premium brands to start pushing 10G ports as a feature, e.g. Apple needs to add it to Macbooks and the Mini and start using it to bludgeon competitors who don't have it. Then once t…

I've noticed 2.5 becoming a bit more common on enthusiast hardware, so it'll be a while yet before 10G becomes mainstream, but 2.5 and 5 might be the standard for new hardware a decade from now.

2.5 and 5 can use existing cat5e or better cabling. There is no solution for 10GigE that uses that cabling.

Re: Add 10 GbE to your system with an M.2 2280 module

#74

Post by ericd »

AceJohnny2 wrote: post #41
buro9 wrote: post #36

Earlier quoted context omitted.

Lots of reasons: 1. Consumer broadband speeds rarely exceed 1Gbps 2. 1Gbps Local network transfers are seldom slowed by the network (as large file work typically involves HDD still) 3. Where local network transfers are impeded by the network speed the transferring itself isn't a frequent enough and blocking thing that people feel they need to fix it... they just go make a cup of tea once or twice a day 4. There are a…

All excellent points but I'd remove gamers from there: > (gamers and video professionals being an exception) I play Stadia, 4K HDR 60FPS, just fine on a gigabit ethernet connection and 150MBit internet connection. Any games not streaming the entire video are fine with just kilobits/s of data, as long as the latency is good. So the case for home 10GE is even weaker ;)

Seems like they're saying that gamers would prefer wired to wifi, which I think is reasonable - it's not so much a bandwidth issue as a latency issue - wifi has higher latency, and higher variance than wired ethernet, especially if you get a crappy client joining and filling up the airtime with retry attempts. But maybe that's dominated by ISP variance for most.

Re: Add 10 GbE to your system with an M.2 2280 module

#75

Post by jamesy0ung »

toast0 wrote: post #10
martijnvds wrote: post #8

Earlier quoted context omitted.

I think the RPi4 doesn't have enough PCIe lanes for 10 gigabit.

Looks like the compute module 4 has one lane of pci-e 2.0, which gets you to 5gbps (theoretically). So yeah, you'll definitely run out of PCI-e bandwidth.

Jeff Geerling got 3.4g with a 4 port Intel NIC

Re: Add 10 GbE to your system with an M.2 2280 module

#76

Post by seany »

loosescrews wrote: post #5

I have had a lot of trouble with the Marvell AQtion controllers under Linux. They are supposed to work and are plug and play on modern kernels, but I was never able to resolve a bug where the controller stopped working after a few hours. The only resolution I found was rebooting, which made the controller not very useful. The Intel 10GbE controllers are more expensive, but much better in my experience. For anyone loo…

I'm using the linked adapter to put mellanox connectx2's into NUCs. Haven't found a good case solution yet, but it all works fine.

Re: Add 10 GbE to your system with an M.2 2280 module

#77

Post by ericd »

AnthonyMouse wrote: post #20
martinald wrote: post #9

It's interesting to see just how slow faster ethernet standards have been. Feels like I've had gigabit ethernet at a pretty low cost for nearly 20 years now, but faster than that has been pretty esoteric outside of the datacentre. I guess there really isn't much demand for faster than gigabit speeds even now (outside of servers?)

It's kind of chicken and egg. It's not worth buying a 10G switch when all or nearly all of your devices are gigabit and it's not worth buying 10G cards for any device when you have a gigabit switch. What you need for the transition is for premium brands to start pushing 10G ports as a feature, e.g. Apple needs to add it to Macbooks and the Mini and start using it to bludgeon competitors who don't have it. Then once t…

I'd say it's worth it as soon as you have a home NAS, it lets you treat it almost as a local drive for any computer that also has 10G.

Re: Add 10 GbE to your system with an M.2 2280 module

#78

Post by soneil »

martinald wrote: post #9

It's interesting to see just how slow faster ethernet standards have been. Feels like I've had gigabit ethernet at a pretty low cost for nearly 20 years now, but faster than that has been pretty esoteric outside of the datacentre. I guess there really isn't much demand for faster than gigabit speeds even now (outside of servers?)

These are naive takes, accounting only for linespeed and nothing more, but give a useful rule of thumb:

- An 8x cdrom narrowly beats 10meg ethernet.

- 1x dvdrom narrowly beats 100meg ethernet.

- ATA133 narrowly beats 1gbit ethernet.

Re: Add 10 GbE to your system with an M.2 2280 module

#79

Post by ericd »

k8sToGo wrote: post #62
vladvasiliu wrote: post #23

Earlier quoted context omitted.

Well, seeing how large SSDs are still very expensive (in my mind it's €100 / TB), my hunch would be that if it makes sense for you to spend that much money on the drives, you probably won't really notice the price of a couple of 10 Gb network cards. They seem quite cheap on eBay if you're OK with used.

It is not the cards that are that expensive. It is also the switches etc. Also SSD are not 100 EUR / TB. A 4 TB SSD is like 300 EUR.

The Mikrotiks are pretty reasonably priced (though you need adapters to go to RJ45, and you can only populate every other port due to heat). But you're right, the low end of switches are generally 10-20x more expensive IME.

Re: Add 10 GbE to your system with an M.2 2280 module

#80

Post by jiggawatts »

Some people are saying that they don't feel the need for > 1 Gbps in a home network.

As a counter-point, I'm regularly limited by 1 Gbps PHY limits. During the 2 years of the pandemic I've been working from home with gigabit Internet. Why gigabit? Because that's the "speed limit" of the Ethernet PHY in the fibre broadband box, and also my laptop's ethernet port.

My laptop can write to disk at multiple GB per second, or tens of gigabits.

I transfer large volumes of data to and from a "jump box" in Azure that can easily do 20 Gbps out to the Internet.

I regularly update multiple Docker images from scratch that are gigabytes in size, each. I then upload similarly large Docker images back to Azure.

Even when physically present at work, I'll regularly pull down 50-200 GB to my laptop for some reason or another. One time I replicated an entire System Center Configuration Manager deployment (packages and all!) to Hyper-V on my laptop because the NVMe drive let me develop build task sequences 20x faster than some crappy "enterprise" VM on mechanical drives.

I have colleagues that regularly do big-data or ML queries on their mobile workstations, sometimes reading in a decent chunk of a terabyte from a petabyte sized data set.

All of these are still limited by Ethernet PHY bandwidths.

Note that servers are 100 Gbps as standard now, and 200 Gbps is around the corner.

The new Azure v5 servers all have 100 Gbps NICs, for example.

Post reply on HN