How to Achieve 20Gb and 30Gb Bandwidth through Network Bonding • Hacker News Board

Re: How to Achieve 20Gb and 30Gb Bandwidth through Network Bonding

#11

Post by virtuallynathan » Fri, Jul 17, 2015, 10:13 PM UTC

pixl97 wrote: post #8

virtuallynathan wrote: post #2

Is it not just cheaper/easier to buy a 40GbE NIC for $350-400 at that point? A 40GbE switch is EDIT: I see they are using RJ45-based 10GbE - this can end up being more expensive and power consuming than SFP+ based stuff (fiber/twinax).

>A 40GbE switch is Huh? Show me a 40Gbe switch for that much per port. The cheapest I see is around $500 per port, plus you need the cabling which can be from $200-$300. Though I agree, I'd rather pay more for the more reliable speed.

Quanta T5032-LY6 + Cumulus Linux = 100G switches are now at 10G is now around $65/port.

Re: How to Achieve 20Gb and 30Gb Bandwidth through Network Bonding

#12

Post by virtuallynathan » Fri, Jul 17, 2015, 10:18 PM UTC

jing wrote: post #9

pixl97 wrote: post #8

Earlier quoted context omitted.

>A 40GbE switch is Huh? Show me a 40Gbe switch for that much per port. The cheapest I see is around $500 per port, plus you need the cabling which can be from $200-$300. Though I agree, I'd rather pay more for the more reliable speed.

DAC is an order of magnitude cheaper than optical and might be fine for their use based on their comments of cat6 v cat6a and "short runs in their lab". Also, if they are using two or three NICs per box, you'd need to factor in the cost of two / three of the X540's vs. a single 40gbe connection and you'd need to double the cost-per-port of the switch vs the 40gbe option.

Yep, that is also a very good point!

Re: How to Achieve 20Gb and 30Gb Bandwidth through Network Bonding

#13

Post by Sanddancer » Fri, Jul 17, 2015, 10:25 PM UTC

brianwawok wrote: post #7

nickpsecurity wrote: post #3

Earlier quoted context omitted.

He did mention redundancy as a benefit.

But if he needs 20Gb.. he needs 20Gb all the time. You can't just slap two 10Gb cards and call it "20Gb redundant" You either need two 20Gb+ cards, or three 10Gb cards.

Sometimes you just need 20Gb most of the time, yet still have availability. Given other bits and pieces of their architecture, occasionally having a box that's temporarily a bit slower shouldn't be a terribly huge issue. It's a cost/benefit tradeoff.

Re: How to Achieve 20Gb and 30Gb Bandwidth through Network Bonding

#14

Post by kev009 » Fri, Jul 17, 2015, 10:27 PM UTC

jing wrote: post #9

pixl97 wrote: post #8

Earlier quoted context omitted.

>A 40GbE switch is Huh? Show me a 40Gbe switch for that much per port. The cheapest I see is around $500 per port, plus you need the cabling which can be from $200-$300. Though I agree, I'd rather pay more for the more reliable speed.

DAC is an order of magnitude cheaper than optical and might be fine for their use based on their comments of cat6 v cat6a and "short runs in their lab". Also, if they are using two or three NICs per box, you'd need to factor in the cost of two / three of the X540's vs. a single 40gbe connection and you'd need to double the cost-per-port of the switch vs the 40gbe option.

Also intel NICs aren't a very good deal, and the driver quality isn't what it once was in common *nixes. The stateless 2x10g and 2x40g cards from Chelsio are cheaper and all around better IMHO.

Re: How to Achieve 20Gb and 30Gb Bandwidth through Network Bonding

#15

Post by nickpsecurity » Fri, Jul 17, 2015, 10:35 PM UTC

Sanddancer wrote: post #13

brianwawok wrote: post #7

Earlier quoted context omitted.

But if he needs 20Gb.. he needs 20Gb all the time. You can't just slap two 10Gb cards and call it "20Gb redundant" You either need two 20Gb+ cards, or three 10Gb cards.

Sometimes you just need 20Gb most of the time, yet still have availability. Given other bits and pieces of their architecture, occasionally having a box that's temporarily a bit slower shouldn't be a terribly huge issue. It's a cost/benefit tradeoff.

Exactly