Earlier quoted context omitted.
My bad - not English, but ASCII. The assumed max tweet size is in bytes rather than (UTF) characters.
I specifically assumed a max tweet size based on the maximum number of UTF-8 bytes a tweet can contain (560), with a link to an analysis of that, and discussion of how you could optimize for the common case of tweets that contain way fewer UTF-8 bytes than that. Everything in my post assumes unicode.
Production Twitter on one machine? 100Gbps NICs and NVMe are fast
41–50 of 500 posts
Re: Production Twitter on one machine? 100Gbps NICs and NVMe are fast
#42There are storage size issues (like how big is their long tail; quite large I'd imagine), but its a fun thing to think about.
Re: Production Twitter on one machine? 100Gbps NICs and NVMe are fast
#43Earlier quoted context omitted.
Kubernetes and containers are a means to service architecture; It enabled scalability but does not require it. You should still be containerizing your applications to ensure a consistent environment, even if you only throw it in a docker-compose file on your production server.
I don't even use containers - I aim primarily for simplicity and so far I have found I am able to build entire sophisticated systems without a single container. Containers I find make things much more complex.
Re: Production Twitter on one machine? 100Gbps NICs and NVMe are fast
#44Most projects I encounter these days instantly reach for kubernetes, containers and microservices or cloud functions. I find it much more appealing to just make the whole thing run on one fast machine. When you suggest this tend to people say "but scaling!", without understanding how much capacity there is in vertical. The thing most appealing about single server configs is the simplicity. The more simple a system ea…
What if your unique machine crash?
Re: Production Twitter on one machine? 100Gbps NICs and NVMe are fast
#45Re: Production Twitter on one machine? 100Gbps NICs and NVMe are fast
#46Re: Production Twitter on one machine? 100Gbps NICs and NVMe are fast
#47Most projects I encounter these days instantly reach for kubernetes, containers and microservices or cloud functions. I find it much more appealing to just make the whole thing run on one fast machine. When you suggest this tend to people say "but scaling!", without understanding how much capacity there is in vertical. The thing most appealing about single server configs is the simplicity. The more simple a system ea…
> The thing most appealing about single server configs is the simplicity. The more simple a system easy, likely the more reliable and easy to understand. What if your unique machine crash?
Re: Production Twitter on one machine? 100Gbps NICs and NVMe are fast
#48Re: Production Twitter on one machine? 100Gbps NICs and NVMe are fast
#49Most projects I encounter these days instantly reach for kubernetes, containers and microservices or cloud functions. I find it much more appealing to just make the whole thing run on one fast machine. When you suggest this tend to people say "but scaling!", without understanding how much capacity there is in vertical. The thing most appealing about single server configs is the simplicity. The more simple a system ea…
> The thing most appealing about single server configs is the simplicity. The more simple a system easy, likely the more reliable and easy to understand. What if your unique machine crash?
Re: Production Twitter on one machine? 100Gbps NICs and NVMe are fast
#50Most projects I encounter these days instantly reach for kubernetes, containers and microservices or cloud functions. I find it much more appealing to just make the whole thing run on one fast machine. When you suggest this tend to people say "but scaling!", without understanding how much capacity there is in vertical. The thing most appealing about single server configs is the simplicity. The more simple a system ea…
> The thing most appealing about single server configs is the simplicity. The more simple a system easy, likely the more reliable and easy to understand. What if your unique machine crash?