Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Pingora, the proxy that connects Cloudflare to the Internet

blog.cloudflare.com

Post reply on HN
Print view View original

11–20 of 127 posts

Re: Pingora, the proxy that connects Cloudflare to the Internet

#11

Post by brink »

nicoburns wrote: post #6

> When crashes do occur an engineer needs to spend time to diagnose how it happened and what caused it. Since Pingora's inception we’ve served a few hundred trillion requests and have yet to crash due to our service code. > In fact, Pingora crashes are so rare we usually find unrelated issues when we do encounter one. Recently we discovered a kernel bug soon after our service started crashing. We've also discovered h…

I had the same experience when I wrote a camera capture / motion detection / video logging service for a commercial smart refrigerator in Rust. The Swift component crashed at least twice a week, the Rust component ran for months and months without issue.

Re: Pingora, the proxy that connects Cloudflare to the Internet

#12

Post by peterhadlaw »

eastdakota wrote: post #3
sullivanmatt wrote: post #2

For any of the Cloudflare team that frequents HN, curious if you have an eventual plan to open-source Pingora? I recognize it may stay proprietary if you consider it to be a differentiator and competitive advantage, but this blog post almost has a tone of "introducing this new technology!" as if it's in the cards for the future.

We are planning on open sourcing it. That's mentioned in the post near the end.

No post body was provided.

Re: Pingora, the proxy that connects Cloudflare to the Internet

#13

Post by RL_Quine »

AtNightWeCode wrote: post #9

Sounds good. I never encountered any performance issues with Cloudflare. If you have the time for enhancement, then: 1. Option to hit the cache before workers. (Why we never use workers). 2. Rules for blocking traffic during nights (time-based rules). 3. Make sure every product is a replacement. If you offer the same thing as a cloud provider. Don’t make us write a lot of custom code.

When is night on the internet?

Re: Pingora, the proxy that connects Cloudflare to the Internet

#15

Post by boris »

I wonder how this is deployed to presumably a large number of hosts? Do you build a distribution package out of your Rust build and ship that? If so, what about the Rust standard library? Though I believe some distributions do provide a package for the Rust standard library, but that means one also has to use the packaged rustc/cargo, which tends to lag behind quite a bit.

Re: Pingora, the proxy that connects Cloudflare to the Internet

#16

Post by pornel »

boris wrote: post #15

I wonder how this is deployed to presumably a large number of hosts? Do you build a distribution package out of your Rust build and ship that? If so, what about the Rust standard library? Though I believe some distributions do provide a package for the Rust standard library, but that means one also has to use the packaged rustc/cargo, which tends to lag behind quite a bit.

Yes, the distribution package is built with `cargo deb`, which automatically makes a suitable binary package. It doesn't need Rust in production. Rust's standard library is compiled into the executable. Its size is negligible, especially with link-time-optimizations.

Re: Pingora, the proxy that connects Cloudflare to the Internet

#17

Post by Sytten »

The post mentions tokio, but I would be curious to see if it uses tower or something similar in house. For our product (caido.io) we also built a custom HTTP parser so if you open source the tool it could be nice to split the parsing in its own crate so we have an alternative to hyper that can understand malformed requests.

Re: Pingora, the proxy that connects Cloudflare to the Internet

#18

Post by totallyunknown »

We did the same. We've replaced nginx/lua with a cache server (for video) written in Golang - now serving up to 100 Gbit/s per node. It's more CPU and memory efficient and completely tailored to our needs. We are happy that we moved away from nginx.

Re: Pingora, the proxy that connects Cloudflare to the Internet

#19

Post by AtNightWeCode »

RL_Quine wrote: post #13
AtNightWeCode wrote: post #9

Sounds good. I never encountered any performance issues with Cloudflare. If you have the time for enhancement, then: 1. Option to hit the cache before workers. (Why we never use workers). 2. Rules for blocking traffic during nights (time-based rules). 3. Make sure every product is a replacement. If you offer the same thing as a cloud provider. Don’t make us write a lot of custom code.

When is night on the internet?

Not uncommon before the intro of edge services to block login on sites during off working hours or during nights. Or at least doing some rate-limiting. We see many attempts at brute force-attacks during the nights. Most sites are not global.
Post reply on HN