Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Add 10 GbE to your system with an M.2 2280 module

cnx-software.com

Post reply on HN
Print view View original

161–170 of 259 posts

Re: Add 10 GbE to your system with an M.2 2280 module

#161

Post by gjulianm »

bradfa wrote: post #139
gjulianm wrote: post #57

Earlier quoted context omitted.

Even 100GbE is hardly seen on company datacenters. Yes, it's cheaper than before, but still more expensive than 10G, and that's extra cost multiplied by all the devices that need to have the improved hardware to take advantage. Plus, most servers won't saturate a 10G link without tweaks on the setup. For 100G it's even worse, I think it will take a long time to see them on datacenters outside of core links or for com…

I think the common knowledge that most servers can't saturate a 10Gb Ethernet link is no longer true. In my experience even saturating 25Gb links is rather easy to do when using 9000 byte MTU on mid-tier server hardware. 100Gb links do take some thought and work to saturate, but that's improving at a good rate lately so I expect it'll become more common rather soon. The main downside to 25Gb and 100Gb links still see…

> In my experience even saturating 25Gb links is rather easy to do when using 9000 byte MTU on mid-tier server hardware.

But that's tweaking the setup already, it requires changes, testing and verification, and can cause problems in downstream equipment. And for a lot of applications, a 9K MTU will not be enough to saturate the link because they'll need NUMA awareness, or the NIC queues will need tweaking to avoid imbalances, or the application is not ready to send at that speed...

I'm not saying it can't be done, of course it can. But it isn't "plug a bigger card and it'll go faster".

Re: Add 10 GbE to your system with an M.2 2280 module

#163

Post by aseipp »

seized wrote: post #160
jjoonathan wrote: post #145

Earlier quoted context omitted.

If somebody knows why they should pay a premium for 10GbE, they also know how bad spinning rust is.

Those same people should also know that spinning rust can go very fast as well... My 8 and 12 drive spinning rust pools can read at 500MB/sec easily and get close to GB/sec. But the 10Gbit network is there for the flash pool.

Yeah, but... The noise! I just can't handle spinning rust anymore for this alone even if the $/GB ratio is still so much better.

Consumer SATA SSDs are plentiful enough that I'm just going all in on flash when I revamp my server and do an 8 drive (+1 hotswap) RAID10 build or whatever. I don't need +60TB or anything and 8-9 drives is about the limit you can find on high end consumer mobos I think...

Re: Add 10 GbE to your system with an M.2 2280 module

#164

Post by zamadatix »

n00p wrote: post #162

I'd love to see a 10gb SFP - USB-C for my laptop I don't know why is this not a thing yet

A small market that cares about 10G performance but don't have a device with a thunderbolt type-c port which performs much better. I'm sure they'll land eventually though.

Re: Add 10 GbE to your system with an M.2 2280 module

#165

Post by omgtehlion »

There are a lot of m.2 to full-PCIe adapters on AliExpress. And a lot of cheap 10G cards on eBay.

I’m using 10G in my home LAN already for ~5 years. And just a month ago I contemplated about upgrading my notebooks to 10G.

I ordered a cheap thunderbolt→nvme adapter (for ssds) + m2→pci-e adapter on AliExpress. And they all work like a charm! Total cost was about $55(tb3 adapter)+5(m.2)+25(network card)+$8(SFP+) = 93USD. A lot cheaper than other options like QNAP or Sonnet Solo (which are in $200+ range)

Re: Add 10 GbE to your system with an M.2 2280 module

#166

Post by toast0 »

emteycz wrote: post #94
ninkendo wrote: post #89

Earlier quoted context omitted.

I don’t see a use case for 10gb Ethernet in your home network in your post, unless I’m missing something? It sounds like your ISP is limited to 1gbps and all your use cases seem to be bottlenecked by it. Do you have home servers you forgot to mention that you’re uploading docker images to, and those could benefit from 10gb Ethernet? (For me, I use gigabit Ethernet everywhere at home but sometimes need to transfer lar…

More devices used at once? If I am downloading 1 Gb/s from the internet, and meanwhile one of my housemates want to look at a movie from our NAS, the other one wants to backup 100 GB of photos to the same NAS - then 1 Gb/s home network is not enough.

Your 1G switch should be able to do 1g from your computer to your internet router and 1G from your roomate to the NAS and whatever from your NAS to the guy watching movies. Even cheap gigabit switches can process (large packets) at line rate on all the ports. If your NAS is also your internet router, maybe you can't make it work with a 1G switch, unless it can do link aggregation.

Re: Add 10 GbE to your system with an M.2 2280 module

#168

Post by omgtehlion »

guywhocodes wrote: post #136
majaxg wrote: post #58

The sonnet solo10g works like a charm with osx and linux with just a thunderbolt port, around 9,8Gbps. Use SFP+ port instead of Ethernet, more options for connection and less power draining.

Been eyeing it for a while now gotta admit. The desktop setup I'm looking at would be pretty expensive with both that and a thunderbolt dock. So annoying I can't get a thunderbolt dock with SFP+ directly instead.

You can DIY it, though. A lot of options on ali/ebay

Re: Add 10 GbE to your system with an M.2 2280 module

#169

Post by omgtehlion »

virtuallynathan wrote: post #134
thfuran wrote: post #121

Earlier quoted context omitted.

In the world of unlimited budgets, where employees all spend their days pulling gigabits per second of egress from the cloud, apparently.

100GbE NICs are <$500, and 100GbE switch ports are $100-150.

while 10G is now at sub-$30 range, totally accessible to everyone )

Re: Add 10 GbE to your system with an M.2 2280 module

#170

Post by jagrsw »

aix1 wrote: post #157
ericd wrote: post #81

Earlier quoted context omitted.

Yeah, the mikrotiks recommend populating only every other slot if you're using RJ45 transceivers to avoid overheating.

Is the power consumption (and heat dissipation) a function of bit rate? E.g. would the same 10GBASE-T transceiver consume less power when running at, say, 2.5Gb/s than at 10Gb/s? Would love to understand this a bit better. (edit: corrected the units.)

Seems so, e.g. this table: https://www.ioi.com.tw/products/proddetail_mobile.aspx?CatID...

  Power consumption (Full bidirectional traffic, 100m cable):
  10G speed: 6.41W
  5G speed: 4.83 W
  2.5G speed: 3.97W
  1G speed: 2.94W
  100M speed: 2.21W
Also https://en.wikipedia.org/wiki/Energy-Efficient_Ethernet
Post reply on HN