Live data from Hacker News

Can Nginx servers scale to the level of Google

news.ycombinator.com

11–20 of 20 posts

Re: Can Nginx servers scale to the level of Google

#11
Can you link sources for those Google numbers? I am asking because I have seen smaller platforms, but still with millions of users, and the avg. RPS was around 10-15k.

Nginx is quite scalable with the right configuration and hardware, but most of the times you want to use more instances of it to scale to this kind of traffic.

Modern, Envoy based proxies are quite popular, and can scale better with better performance, mostly due to the fact it’s written in C++.

Re: Can Nginx servers scale to the level of Google

#14
Probably yes.

You can scale horizontally with a lot of web servers and load balance them. You don't need to stretch load balancer clusters across AZs/regions, so I see no reason why Nginx wouldn't work.

I assume at that scale session cookies are shared without application server clustering. A distributed KV store is probably enough.

Re: Can Nginx servers scale to the level of Google

#15

Earlier quoted context omitted.

Nothing wrong with NGINX. Read Cloudflare post on Pingora. Different needs for different usecases where NGINX is more of an OOTB situation. NGINX is great. I see Caddy mentioned quite a bit, believe it’s written in Go where NGINX is written in C. Cloudflare wrote Pingora in Rust IIRC and I want to say they are releasing an open source flavor

Hmm I read the post. Cloudfare handles almost 1 trillion requests per day, Google does that per year. However, the request types are different, Cloudfare handles a variety of requests like caching and forwarding, while Google requests are about serving complete web pages. May be for the webserver purpose like Google Nginx may suffice?

I'm sorry but those numbers can't be right. Google Analytics is embedded in enough sites to hit a trillion hits a day.

Re: Can Nginx servers scale to the level of Google

#16

Nginx is not going to be your bottleneck. If it is, you don't need to be asking on here. :)

We don’t all work directly with megascale systems. It can still be interesting to learn about how those systems work, and what considerations need to be made in those circumstances.

Re: Can Nginx servers scale to the level of Google

#18

Earlier quoted context omitted.

Nothing wrong with NGINX. Read Cloudflare post on Pingora. Different needs for different usecases where NGINX is more of an OOTB situation. NGINX is great. I see Caddy mentioned quite a bit, believe it’s written in Go where NGINX is written in C. Cloudflare wrote Pingora in Rust IIRC and I want to say they are releasing an open source flavor

Hmm I read the post. Cloudfare handles almost 1 trillion requests per day, Google does that per year. However, the request types are different, Cloudfare handles a variety of requests like caching and forwarding, while Google requests are about serving complete web pages. May be for the webserver purpose like Google Nginx may suffice?

Cloudflare serves web pages bro because they proxy the bytes between servers from origin to eyeball

Re: Can Nginx servers scale to the level of Google

#19
post #14

Probably yes. You can scale horizontally with a lot of web servers and load balance them. You don't need to stretch load balancer clusters across AZs/regions, so I see no reason why Nginx wouldn't work. I assume at that scale session cookies are shared without application server clustering. A distributed KV store is probably enough.

Hi, I thought so too. But then why did it not work for Cloudflare, and why did their custom solution work with Pingora?

Re: Can Nginx servers scale to the level of Google

#20
post #14

Probably yes. You can scale horizontally with a lot of web servers and load balance them. You don't need to stretch load balancer clusters across AZs/regions, so I see no reason why Nginx wouldn't work. I assume at that scale session cookies are shared without application server clustering. A distributed KV store is probably enough.

Hi, I thought so too. But then why did it not work for Cloudflare, and why did their custom solution work with Pingora?

As it turns out, they didn't like that each requests lands on a single worker and can only reuse connections on that worker, which gets worse as the number of workers per server increases. Presumably, scaling horizontally wasn't cost efficient enough.

They also wanted something written in a memory-safe language so it could be extended without easily falling into memory safety issues. NGINX is written in C.

Post reply on HN