Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Pingora, the proxy that connects Cloudflare to the Internet

blog.cloudflare.com

Post reply on HN
Print view View original

31–40 of 127 posts

Re: Pingora, the proxy that connects Cloudflare to the Internet

#32

Post by BonoboIO »

totallyunknown wrote: post #18

We did the same. We've replaced nginx/lua with a cache server (for video) written in Golang - now serving up to 100 Gbit/s per node. It's more CPU and memory efficient and completely tailored to our needs. We are happy that we moved away from nginx.

Wow ... 100 Gbit/s. Where do you work? That’s some serious traffic.

Re: Pingora, the proxy that connects Cloudflare to the Internet

#33

Post by datalopers »

xfalcox wrote: post #5

I share lots of feelings towards NGINX that Cloudflare mention on this blog post. New features like 103 Early Hints and HTTP/3 exist in HAProxy and Caddy but there is nothing coming in NGINX.

nginx was good for a decade or two. they were acquired and doomed to irrelevancy since.

Re: Pingora, the proxy that connects Cloudflare to the Internet

#34

Post by trillic »

BonoboIO wrote: post #32
totallyunknown wrote: post #18

We did the same. We've replaced nginx/lua with a cache server (for video) written in Golang - now serving up to 100 Gbit/s per node. It's more CPU and memory efficient and completely tailored to our needs. We are happy that we moved away from nginx.

Wow ... 100 Gbit/s. Where do you work? That’s some serious traffic.

100 Gbit/s is only like 3000 concurrent viewers at 5000 KiB/s.

Re: Pingora, the proxy that connects Cloudflare to the Internet

#35

Post by kronololo »

What are HTTP status codes greater than 599 used for in practice?

It'd be interesting to see another Cloudflare blog post that just goes into detail on the weird protocol behaviour they've had to work around over the years. I imagine they have more insight into this than pretty much any other organisation on the planet.

Re: Pingora, the proxy that connects Cloudflare to the Internet

#37

Post by petr_tik »

jhgg wrote: post #23
nicoburns wrote: post #6

> When crashes do occur an engineer needs to spend time to diagnose how it happened and what caused it. Since Pingora's inception we’ve served a few hundred trillion requests and have yet to crash due to our service code. > In fact, Pingora crashes are so rare we usually find unrelated issues when we do encounter one. Recently we discovered a kernel bug soon after our service started crashing. We've also discovered h…

We had the same experience at work deploying rust services that serve many billions of requests a day as well.

does your company have any public information about this? Blogs, job descriptions with numbers, twitter threads?

Re: Pingora, the proxy that connects Cloudflare to the Internet

#38

Post by drogus »

nicoburns wrote: post #6

> When crashes do occur an engineer needs to spend time to diagnose how it happened and what caused it. Since Pingora's inception we’ve served a few hundred trillion requests and have yet to crash due to our service code. > In fact, Pingora crashes are so rare we usually find unrelated issues when we do encounter one. Recently we discovered a kernel bug soon after our service started crashing. We've also discovered h…

I had a very similar experience. Much smaller scale, but the service was keeping internal state and clients were connecting with a WebSocket. It could handle up to a million clients on one server and it practically never crashed. While I was writing it I had only hobby-level experience with Rust and I was also mentoring a colleague, so he wrote a big chunk of code as a total Rust noob.
Post reply on HN