Live data from Hacker News

Spotify moves its back end to Google Cloud

news.spotify.com

61–70 of 397 posts

Re: Spotify moves its back end to Google Cloud

#61
post #28

Earlier quoted context omitted.

I'd be curious if anyone knows the details about why: complexity, customer complaints, reliability?

Too much complexity for a world that's moving to mobile clients that can't be active peers of the network.

Seems to be a pattern: wimpy mobile endpoint devices drive everything to the cloud.

If so this is perhaps a dated phenomenon. Moore's Law is still a thing and today's generation of mobile devices are getting fatter and fatter.

Re: Spotify moves its back end to Google Cloud

#62
post #45

Earlier quoted context omitted.

We offer paid support for Cloud ( http://cloud.google.com/support ) that let you trade off responsive time (e.g., 4 hours vs 1) for price. The support personnel (and engineering!) also do best effort scanning of Stack Overflow, Server Fault, and per-product mailing lists. You can get links to those here: https://cloud.google.com/support/#community . Disclaimer: I work on Compute Engine, but not in Support (though I d…

What kind of support am I going to get if I'm just tinkering with the platform? Maybe I'm just used to AWS but I always found the GCE interface (at least for launching VMs) a lot more difficult to use.

Sorry to hear that. Is there something specific about our current console you find hard to use? Perhaps I'm used to both (and I'm biased) but I like our create instance page just fine.

Like I mentioned above, we do have active communities on Stack Overflow, per-product mailing lists (in this case https://groups.google.com/forum/#!forum/gce-discussion) and Server Fault.

Re: Spotify moves its back end to Google Cloud

#63

What Google Cloud needs is a better sales story. AWS consistently beats out Google in this respect. This story is welcomed and there should be more success stories published like this. My business is a heavy GC user (AppEngine, Datastore, CloudStorage, BQ, ComputeEngine, ManagedVM) and I couldn't imagine achieving what we have achieved in such a short amount of time on any other platform. We (myself and another guy)…

You could have done the same on AWS (source: I have worked at AWS for 6 years, and know GCP very well)

Re: Spotify moves its back end to Google Cloud

#64
post #30

Isn’t it risky to move to competition's infrastructure?

Not really - many people rely on Google Cloud and if Google made it harder for Spotify to compete (via, say, raising prices for Google Cloud for them), they'd have to be pretty specific to Spotify to not cause other customers to move to AWS or Azure.

Spotify has much bigger risks in their licensing deals.

Re: Spotify moves its back end to Google Cloud

#67

What Google Cloud needs is a better sales story. AWS consistently beats out Google in this respect. This story is welcomed and there should be more success stories published like this. My business is a heavy GC user (AppEngine, Datastore, CloudStorage, BQ, ComputeEngine, ManagedVM) and I couldn't imagine achieving what we have achieved in such a short amount of time on any other platform. We (myself and another guy)…

> infinitely auto-scalable platform where we don't have to do any devops or carry a pager You never know what you don't measure and test

One of the big advantages of Google Cloud platform is "Scalability".

Load balancers: Scale to millions of users seamlessly. No warming up, no tickets, ...

PubSub: You can send the whole Internet 10 times in a day through it. Google does that every day

Big Query: Its equivalent to spinning up a 100+ node cluster in a matter of seconds and it can process data at speeds of GB's of data per sec, I heard couple of use cases where the user was able to process at ~ 50 GB/s

Kubernetes: 1000's of nodes running 100's of thousands of containers.

Can't beat that!

Re: Spotify moves its back end to Google Cloud

#68

I was wondering about Spotify's contributions to Hadoop stack such as Snakebite and Luigi. What will happen to these projects if they're moving to BigQuery?

Spotify are not moving to BigQuery alone. They are also using Dataproc, Google's managed Hadoop service (which co-incidentally went GA yesterday), which lets them get value out of all the orchestration tools they already use, like Luigi. (They are also adopting Cloud Dataflow, Cloud Pub/Sub and other parts of our Big Data stack.)

Luigi has had BigQuery support for some time: https://github.com/spotify/luigi/pull/1002

Spotify will be talking more about the specifics of their data pipelines at GCP Next in SF in March, - I would expect to see a lot more on the new Google Cloud Big Data blog at https://cloud.google.com/blog/big-data/ too.

[Disclosure, GCP guy, etc]

Re: Spotify moves its back end to Google Cloud

#69
post #57

Earlier quoted context omitted.

I want to see your lovely face in the office every day. =)

Man, you should consider remote options at least for the Customer Success given how low you're paying (is $50K really livable in San Francisco?).

Depends on your standard of living. A studio apartment there goes for around $2500/month these days with no parking or utilities. Agreed that remote would be a nice option.

Re: Spotify moves its back end to Google Cloud

#70

What Google Cloud needs is a better sales story. AWS consistently beats out Google in this respect. This story is welcomed and there should be more success stories published like this. My business is a heavy GC user (AppEngine, Datastore, CloudStorage, BQ, ComputeEngine, ManagedVM) and I couldn't imagine achieving what we have achieved in such a short amount of time on any other platform. We (myself and another guy)…

I've been relying on multiple Cloud offerings (including PaaS, IaaS etc) outside Google for many years, but for some unclear reason, I cannot manage to consider Google a reliable partner for a type of hosting or another, at this point. I would love to be proven wrong really, because I often look at their GC offering, and I /really/ want to dive in, yet I feel that I would risk having to migrate quickly in 2 weeks at…

I should add, I've been on top of AppEngine for about 4 years now. This is my second business on it.
Post reply on HN