On Linux there’s a spinlock in do soft_irq that blocks even in non-blocking IO.
NUMA Siloing in the FreeBSD Network Stack [pdf]
71–80 of 137 posts
Re: NUMA Siloing in the FreeBSD Network Stack [pdf]
#72So why is it important to have a multisocket NUMA machine? Why not just save yourself a lot of hassle by having one socket? I know that the previous generation AMD machine had unavoidable NUMA but the new one doesn't.
Re: NUMA Siloing in the FreeBSD Network Stack [pdf]
#73Earlier quoted context omitted.
They also have their own CDN, to reduce load on ISPs. https://media.netflix.com/en/company-blog/how-netflix-works-...
you make it sound altruistic. it’s to avoid paying ISPs
Re: NUMA Siloing in the FreeBSD Network Stack [pdf]
#74So why is it important to have a multisocket NUMA machine? Why not just save yourself a lot of hassle by having one socket? I know that the previous generation AMD machine had unavoidable NUMA but the new one doesn't.
It may be a bit early to have a presentation from the latest Epyc processors. Most of the work was likely done with previous processors, but their slides said their AMD boxes are single socket.
Re: NUMA Siloing in the FreeBSD Network Stack [pdf]
#75The Linux network stack has been the bane of my existence trying to squeeze more performance out of KeyDB. I really hope it gets this kind of love in the future. On Linux there’s a spinlock in do soft_irq that blocks even in non-blocking IO.
Re: NUMA Siloing in the FreeBSD Network Stack [pdf]
#76So why is it important to have a multisocket NUMA machine? Why not just save yourself a lot of hassle by having one socket? I know that the previous generation AMD machine had unavoidable NUMA but the new one doesn't.
Re: NUMA Siloing in the FreeBSD Network Stack [pdf]
#77So why is it important to have a multisocket NUMA machine? Why not just save yourself a lot of hassle by having one socket? I know that the previous generation AMD machine had unavoidable NUMA but the new one doesn't.
Pretty sure Intel single socket of this generation is totally non-viable for this workload due to lack of PCIe lanes. Maybe viable when Intel gets gen4 PCIe.
Re: NUMA Siloing in the FreeBSD Network Stack [pdf]
#78Re: NUMA Siloing in the FreeBSD Network Stack [pdf]
#79Isn't it great that we work in an industry where a company like Netflix, which has increasing competition lately, just shares potential competitive advantages like this? I get that, in part, this is a way to get people excited to work for Netflix, however, the people working on this are, probably, pretty proud of what they achieved and thus like to share it with us, their colleagues at other places of work and they h…
> ... just shares potential competitive advantages like this? Is it really a competitive advantage though? I would think that their brand and content library are the main ones. A CDN server doesn't really count IMHO: other streaming services can create their own appliances, though I'm guessing they'll use Linux due to its ubiquity. Though as a long-time FreeBSD fan and part-time user, I'm happy for the patches. I run…
It totally is. These things get installed into ISP racks. ISPs have limited space and power for these things. One box pushing 200Gbps in the same space is twice as good (although, note they have 4x100Gbps NICs in this generation, there's room for more perf here).
Reducing the number of nodes helps with management of the network as well.
Re: NUMA Siloing in the FreeBSD Network Stack [pdf]
#80Is it still accurate that for network bound servers that FreeBSD still outperforms Linux?