Live data from Hacker News

NUMA Siloing in the FreeBSD Network Stack [pdf]

people.freebsd.org

131–137 of 137 posts

Re: NUMA Siloing in the FreeBSD Network Stack [pdf]

#131
post #118

Earlier quoted context omitted.

By chipset, you mean northbridge? Or the CPU? The part I know of that is built into the CPU is a DMA engine called I/OAT; it just does DMA and maybe basic checksum and RAID transformations. It is sometimes confused with QAT (I've personally confused the two...): https://www.intel.com/content/www/us/en/wireless-network/acc...

The northbridge. my understanding is that they no longer sell the discrete cards to perform these tasks, and instead offload it to chips that come on the boards.

That might be true, but you can still buy the cards from 3rd party resellers, e.g., https://www.newegg.com/p/2AS-006R-00046 .

Re: NUMA Siloing in the FreeBSD Network Stack [pdf]

#132

Earlier quoted context omitted.

What's "a lot" here, and are you sure that's still true? Because my suspicion is that it might have been true before FAANG sunk billons of R&D into Linux, but I would be shocked if Linux kernels cash at any rare worth noticing today. Although it's splitting hairs, really; when is the last time you saw any major kernel crash?

I crash FreeBSD every day :)

you're making me want to start building some BSD boxes

Re: NUMA Siloing in the FreeBSD Network Stack [pdf]

#133

Isn't it great that we work in an industry where a company like Netflix, which has increasing competition lately, just shares potential competitive advantages like this? I get that, in part, this is a way to get people excited to work for Netflix, however, the people working on this are, probably, pretty proud of what they achieved and thus like to share it with us, their colleagues at other places of work and they h…

I like it, I think its spreading, and I think its a good thing for the world. "Top U.S. CEOs say companies should put social responsibility above profit" https://www.reuters.com/article/us-jp-morgan-business-roundt...

Social responsibility over profit is not legal in the USA. Fiduciary duty, EBay v Newmark

Re: NUMA Siloing in the FreeBSD Network Stack [pdf]

#134
post #70

Earlier quoted context omitted.

BSDs unwavering commitment to reliability. A Linux kernel crashes. A lot. FreeBSD ran cdrom.com for 365+ days without rebooting. Just saying

What's "a lot" here, and are you sure that's still true? Because my suspicion is that it might have been true before FAANG sunk billons of R&D into Linux, but I would be shocked if Linux kernels cash at any rare worth noticing today. Although it's splitting hairs, really; when is the last time you saw any major kernel crash?

Reminder: Facebook tried to run the WhatsApp stack on Linux but they kept having kernel panics

Re: NUMA Siloing in the FreeBSD Network Stack [pdf]

#135
post #61

Earlier quoted context omitted.

Not all of them are landed in CURRENT yet, much less stable/12. They'll be in 13.0; I can't speak to any future stable 12.2. On the other hand, CURRENT is pretty solid. A lot of folks, Netflix included, just run CURRENT.

Wait, they run CURRENT in production? Is that... safe?

If you have kernel developers on your staff: yes

Re: NUMA Siloing in the FreeBSD Network Stack [pdf]

#136
post #16

Earlier quoted context omitted.

If it's just serving files you don't necessarily need DPDK/XDP. For server-grade hardware there now is P2P-DMA and TLS accelerators which can offload everything to peripherials while still using normal socket APIs. You get NVMe -(PCIe)-> crypto accelerator -(PCIe)-> ethernet for the bulk of the data. Neither CPU nor main memory see any of the network packets as long as they stay on the happy path. Only connection set…

I know Chelsio has crypto directly on the NIC, but are dedicated crypto accelerator cards a thing and are they ever worth it? Why leave the CPU idle when the CPU itself is a good crypto accelerator (AES-NI, ARMv8 crypto)? AMD Ryzen has a built-in crypto "decelerator" — a FreeBSD driver was written for the crypto engine, but it's disabled by default because it made everything slower than AES-NI. (Though I guess it wou…

Yeah, sorry, I misremembered. The middle device of the chain in the motivating example given for P2P-DMA was for compression, not encryption.

https://www.snia.org/sites/default/files/SDC/2018/presentati...

Re: NUMA Siloing in the FreeBSD Network Stack [pdf]

#137
post #86
post #84

Earlier quoted context omitted.

It's funny to think that pushing 196gbps is possibly just as little as ~8000 simultaneous streams. Also a shame that it is TLS'd. The content already has its own DRM/encryption.

TLS plays a different role. It makes sure you're receiving the Netflix's DRMed and encrypted content, and not some MITMed content that also happens to be correctly DRMed and encrypted, but contains something else.

TLS keeps your viewing history private from third parties (e.g. your ISP).
Post reply on HN