Live data from Hacker News

Why WhatsApp Only Needs 50 Engineers for Its 900M Users

wired.com

191–200 of 255 posts

Re: Why WhatsApp Only Needs 50 Engineers for Its 900M Users

#191

WhatsApp seems to be a great example of designing your system with the best tools available. To go from nothing to pretty much being the de-facto modern replacement for SMS in a couple of years is an amazing achievement. I really need to sit down and spend some time properly learning a functional language. I can hack my way through Haskell code but I do it in a very non-Haskell way. I really need to change that. My p…

Any book on Lambda calculus http://www.amazon.com/Introduction-Functional-Programming-Ca...

https://www.edx.org/course/introduction-functional-programmi...! is a MOOC in Haskell

Re: Why WhatsApp Only Needs 50 Engineers for Its 900M Users

#192

Earlier quoted context omitted.

We do have an initial hour meeting with candidates just to get to know them and propose the trial if they seem like a possibility. Wouldn't most people take a day off to interview somewhere? I know I wouldn't be comfortable ducking out for a few hours to interview — it would feel tense and uncomfortable. Facebook, and I'm sure many other places, do full-day interviews. It's certainly not unusual.

> Wouldn't most people take a day off to interview somewhere? Not always possible. One of the big annoyances when I was working for a company was that if I wanted time off it was two weeks notice. Doesn't work particularly well when the interview invitation tends to be more along the lines of, 'Hi, your interview date is next week.'

Or maybe you have had many life events (births, deaths, etc.) and your employer wasn't very understanding. So you've already burned all your time off and are ready to find an employer who's a better fit.

Re: Why WhatsApp Only Needs 50 Engineers for Its 900M Users

#193
post #160

Earlier quoted context omitted.

>However of all the various applications you could conceivably scale to hundreds of millions of users this is one of the simplest. I do not think acknowledging that is cringeworthy at all. What other apps besides social networking and communication apps even get to hundreds of millions of user?

I guess "users" is a confusing concept, but a service like Cloudflare would be an example of a more complex application serving that scale of people.

Is cloudflare more complex or less? If I'm connecting through a CF proxy in North America and someone else is connecting through Europe, there's not really any state that needs to be synchronized between us. If I send a message to somebody in Europe, that obviously does need to be synced.

Re: Why WhatsApp Only Needs 50 Engineers for Its 900M Users

#194

Earlier quoted context omitted.

I guess "users" is a confusing concept, but a service like Cloudflare would be an example of a more complex application serving that scale of people.

Is cloudflare more complex or less? If I'm connecting through a CF proxy in North America and someone else is connecting through Europe, there's not really any state that needs to be synchronized between us. If I send a message to somebody in Europe, that obviously does need to be synced.

Actually there is state that might need to be synchronized between the two locations. The cached state of the page or other resources there. CF doesn't just do a blind proxy to the host, along with that it does a number of checks for common attacks and other misbehaving clients.

Re: Why WhatsApp Only Needs 50 Engineers for Its 900M Users

#195

Here's part of what I don't get - there are so many government organizations, state and federal, jumping over themselves to provide funding, incubation and support to IT product/app companies across the country claiming it creates jobs when, as this shows, it is entirely possible to operate at incredible scale nowadays with a mere skeleton staff. So why do so many government-run and government-funded programs fawn ov…

So why do so many government-run and government-funded programs fawn over such companies when their ultimate goal is job creation and these companies are designed to run with barely a couple dozen people at most?

The people rich enough for congress' ear says the jobs are hard to fill. What the employers mean is that they're expensive. What the government hears is high demand. Government will champion tech work until labor costs are driven down.

Re: Why WhatsApp Only Needs 50 Engineers for Its 900M Users

#196

Earlier quoted context omitted.

Is cloudflare more complex or less? If I'm connecting through a CF proxy in North America and someone else is connecting through Europe, there's not really any state that needs to be synchronized between us. If I send a message to somebody in Europe, that obviously does need to be synced.

Actually there is state that might need to be synchronized between the two locations. The cached state of the page or other resources there. CF doesn't just do a blind proxy to the host, along with that it does a number of checks for common attacks and other misbehaving clients.

The NA data center can't decide how long to cache a page without consulting EU (and Asia, and SA, and etc.)? Obviously there is some shared global state (how else would each endpoint know where to proxy to?), but it seems unlikely every request passing through CF is mutating the same global database.

Re: Why WhatsApp Only Needs 50 Engineers for Its 900M Users

#197
post #162
post #109

Earlier quoted context omitted.

Reading through comments, I think there is an undercurrent of slight envy or resentment (perhaps unconscious) both towards WhatsApp and Erlang. We are rational people so we'll never admit to that, so it comes out in other objections "It is a simple system", "I could do the backend in a weekend"... There are a lot of startup people here, who work at a startup, bet their time, money, life? on one, and talking about a s…

I resent them because Whatsapp is terrible, terrible software compared to Facebook Messenger yet somehow made $19B. 1. No web interface, I'm forced to use a tiny mobile keyboard 2. Identity tied to my phone number which changes every month 3. Ugly (subjective) 4. My friends are already on Facebook, why have another service that does the same thing but worse. 5. No chat bubbles. 6. No meme search I could go on and on.…

> 1. No web interface, I'm forced to use a tiny mobile keyboard

No idea how recent this is, I discovered it a couple of weeks ago: https://web.whatsapp.com/

Re: Why WhatsApp Only Needs 50 Engineers for Its 900M Users

#198
post #160
post #158

Earlier quoted context omitted.

I don't think anyone commenting along these lines on HN is that ignorant. Everyone on here understands that anything executed at the WhatsApp/FB/Instagram sort of scale is going to present all sorts of tough problems and require software engineering know-how in spades. However of all the various applications you could conceivably scale to hundreds of millions of users this is one of the simplest. I do not think ackno…

>However of all the various applications you could conceivably scale to hundreds of millions of users this is one of the simplest. I do not think acknowledging that is cringeworthy at all. What other apps besides social networking and communication apps even get to hundreds of millions of user?

There's still a big difference between WhatsApp and the likes of Facebook when it comes to complexity. Last I checked, WhatsApp does not do face recognition, to pick an example at random.

Re: Why WhatsApp Only Needs 50 Engineers for Its 900M Users

#199

If this isn't a counter to the inane recruiting requirements of "5 years with language X" I don't know what is: We don’t bring them in specifically because the engineer knows Erlang,” Mahdavi said on Monday. “We expect the engineer to come in and spend their first week getting familiar with the language and learning to use the environment. If you hire smart people, they’ll be able to do that.”

This reminds me of how we have been hiring engineers. We sit them down for a day with a fairly simple task (build a simple web or mobile app, about three screens with a basic data model) but we make sure to give them a language or framework they are unfamiliar with. They have Google, Stack Overflow, and other employees to use as a resource. It's a great way to get to know new hires while seeing how resourceful and in…

Can you share where you work? :)

Re: Why WhatsApp Only Needs 50 Engineers for Its 900M Users

#200
I'm surprised that nobody mentioned why whatsapp started with Erlang in the first place. They started out with an open source xmpp package. The most popular one at the time happened to be written in Erlang (ejabberd). There was no masterplan to scale to close to a billion accounts.

As it happens, Erlang is an excellent platform upon which to build a message exchange service. Also, the article doesn't mention their completely non-traditional approach to ops. Despite the conventional wisdom in the valley, they run their own servers. And squeeze an enormous amount of value from a small number of servers. Their unique ops strategy is probably as much a part of their success as simply using Erlang.

http://www.erlang-factory.com/static/upload/media/1394350183...

Post reply on HN