Live data from Hacker News

New Optical Form Factors for 400 Gigabit Ethernet

lightwaveonline.com

1–10 of 78 posts

Re: New Optical Form Factors for 400 Gigabit Ethernet

#3
post #2

Does aanyone here work with consuming (not just passing it kn) these amounts of traffic? How do you manage to get anything meaningful out of it?

network engineer here: nobody connects a 200 or 400GbE interface linecard off a router to a single anything... The purpose is for ISP-to-ISP interconnections for truly huge amounts of traffic. For example direct peering in the same IX/carrier hotel between a huge source of content (youtube/google, netflix, etc) and a huge ISP (comcast, centurylink).

For a big ISP, also things like 100GbE connections from a city's pair of core routers to slightly smaller aggregation routers.

edit: I don't know that anything "consumes" data in the way that the questioner is asking. It's more about the aggregate amount of data. One netflix 4K stream to an xbox one s is about 15.75 Mbps. Now multiply that by a hundred thousand netflix subscribers in a typical comcast service area, any of whom at any given time might be sitting around and watching Altered Carbon or Breaking Bad.

Re: New Optical Form Factors for 400 Gigabit Ethernet

#4
post #2

Does aanyone here work with consuming (not just passing it kn) these amounts of traffic? How do you manage to get anything meaningful out of it?

Network Engineer here as well - I support one of the world's largest enterprise organizations (although my area of 'expertise' is pretty far down the stack - somewhere between the internet and the WAN circuits) - I can see no personal use for a 400 GbE port on anything.

As far as my organization goes, there will always be a bottleneck somewhere else (speaking location to location across the WAN).

The only applications I could see this being useful would be maybe huge ISP interconnects or maybe some big players in the video streaming world. That doesn't mean that future-proofing is a bad thing - of course cost will probably be a very large concern in the case of 400GbE...I see a lot of 40 gig ports that go completely unused, personally.

Re: New Optical Form Factors for 400 Gigabit Ethernet

#5
post #4
post #2

Does aanyone here work with consuming (not just passing it kn) these amounts of traffic? How do you manage to get anything meaningful out of it?

Network Engineer here as well - I support one of the world's largest enterprise organizations (although my area of 'expertise' is pretty far down the stack - somewhere between the internet and the WAN circuits) - I can see no personal use for a 400 GbE port on anything. As far as my organization goes, there will always be a bottleneck somewhere else (speaking location to location across the WAN). The only application…

It's not hard to imagine 100GbE being used inside datacenters. AFAIK, 40GbE top of rack switch is pretty common.

Re: New Optical Form Factors for 400 Gigabit Ethernet

#6
post #5
post #4

Earlier quoted context omitted.

Network Engineer here as well - I support one of the world's largest enterprise organizations (although my area of 'expertise' is pretty far down the stack - somewhere between the internet and the WAN circuits) - I can see no personal use for a 400 GbE port on anything. As far as my organization goes, there will always be a bottleneck somewhere else (speaking location to location across the WAN). The only application…

It's not hard to imagine 100GbE being used inside datacenters. AFAIK, 40GbE top of rack switch is pretty common.

I've seen some 160GbE links in datacenters - 4x40's - how much they were actually utilized, I have no idea.

Re: New Optical Form Factors for 400 Gigabit Ethernet

#7
I remember having to schedule a 780Kb download overnight and hoping no one picked the phone up. Or years later having to download shows in advance (illegally because they weren’t available) because streaming wasn’t possible.

Now I casually (and legally) boot up any show I feel like within seconds at HD resolutions. I love thinking about the sheer amount of data that is traversing around the internet now. And it’s more fun to imagine what becomes possible when you bump up another order of magnitude or two.

In games for instance, a significant limiting factor for implementing large player counts in fast-paced multiplayer come down to bandwidth. The amount needed, for the most part, scales linearly per-player as the player count increases. Add more bandwidth (and some more CPU power) and games can evolve entirely new experiences.

The battle royale games like PUBG are a great example, but due to bandwidth issues and CPU usage the server tick rate is much slower than normal fast-paced games (20hz vs 60hz) and therefore the experience suffers quite a bit.

Re: New Optical Form Factors for 400 Gigabit Ethernet

#8

I remember having to schedule a 780Kb download overnight and hoping no one picked the phone up. Or years later having to download shows in advance (illegally because they weren’t available) because streaming wasn’t possible. Now I casually (and legally) boot up any show I feel like within seconds at HD resolutions. I love thinking about the sheer amount of data that is traversing around the internet now. And it’s mor…

Multiplayer gaming has more issues with latency than a lack of raw bandwidth.

Re: New Optical Form Factors for 400 Gigabit Ethernet

#10
post #5
post #4

Earlier quoted context omitted.

Network Engineer here as well - I support one of the world's largest enterprise organizations (although my area of 'expertise' is pretty far down the stack - somewhere between the internet and the WAN circuits) - I can see no personal use for a 400 GbE port on anything. As far as my organization goes, there will always be a bottleneck somewhere else (speaking location to location across the WAN). The only application…

It's not hard to imagine 100GbE being used inside datacenters. AFAIK, 40GbE top of rack switch is pretty common.

if you have a really beefy single bare metal hypervisor (typically xen or kvm) it's totally possible to give it 100GbE to the switch now:

http://www.silicom-usa.com/pr/server-adapters/networking-ada...

I don't have anything this serious in my own production use, but I'm thinking of machines like dual socket x 32-core per socket xeons, or amd epyc, with 512GB to 1TB of RAM.

then pass vlan tagged traffic off one switch port, to each specific guest VM, of which there might be dozens to 100+ VMs, as subinterfaces of that.

Post reply on HN