Live data from Hacker News

Spotify moves its back end to Google Cloud

news.spotify.com

121–130 of 397 posts

Re: Spotify moves its back end to Google Cloud

#121
post #61

Earlier quoted context omitted.

Too much complexity for a world that's moving to mobile clients that can't be active peers of the network.

Seems to be a pattern: wimpy mobile endpoint devices drive everything to the cloud. If so this is perhaps a dated phenomenon. Moore's Law is still a thing and today's generation of mobile devices are getting fatter and fatter.

Moore's Law has not been improving batteries, which is the real problem. Mobile P2P nodes need to be awake most/all the time, which is a real battery killer. Modern devices have improved battery life by being asleep almost all the time.

Re: Spotify moves its back end to Google Cloud

#122
I notice App Engine isn't mentioned in their stack. I'm a bit worried that Google abandons it once Snapchat moves off it. It has already been in maintenance mode for some years now (save for Managed VMs). The writing was on the wall when Guido left the team. Apparently Google still uses it internally (as the recent switch to Monorail made evident), so perhaps it's safe for a few more years.

Re: Spotify moves its back end to Google Cloud

#123
post #57

Earlier quoted context omitted.

Man, you should consider remote options at least for the Customer Success given how low you're paying (is $50K really livable in San Francisco?).

I survive on ~$35k post-tax in SF. Though I make more than that.

...and I'm assuming you've got some killer rent control, or some other non-scalable, non-replicable housing situation. That's neat for you, but it's meaningless to anybody else.

Re: Spotify moves its back end to Google Cloud

#124

Earlier quoted context omitted.

Google Cloud SQL is no replacement for Amazon RDS in my opinion. Cloud SQL instances run outside of your project's private network, so connections from Google Compute Engine have to be over a Public IP. This means accepting connections from any host (insecure) or whitelisting each Google Compute Engine VM's IP address (pain in the ass). I've resorted to running my own MySQL instance inside of Google Compute Engine an…

So, basically something like AWS's VPC? Given that it took them a few years to get that right even with tons of people asking for it, I'm not super optimistic that Google could match it any time soon. I'd love to be wrong!

GCE networking was always equivalent to AWS VPC, but there's new functionality in stuff like Cloud Router, subnetworks, and other beta features to expand that even more. Here's the Network Services section from a guide explaining GCP for people who are used to AWS:

> The differences between AWS networking and Google Cloud networking are significant. This due to the nature of how these services were designed. Google Cloud Platform treats networking as something that spans all services, not just compute services. It is based on Google’s Andromeda software-defined networking architecture, which allows for creating networking elements at any level with software. As a result, Cloud Platform can create a network that fits Google's needs exactly—for example, create secure firewalls for virtual machines in Google Compute Engine, allow for fast connections between database nodes in Cloud Bigtable, or deliver query results quickly in BigQuery.

> To create an instance in Google Compute Engine, you need a network. In Google Cloud Platform, we create a default network for you automatically, and you can create more as needed. Unlike AWS, there is no choice of a public network like Elastic Compute Cloud-Classic. In all cases, you create a private network, much like Elastic Compute Cloud-VPC. Unlike Elastic Compute Cloud-VPC, Google Networking does not have sub-networking, but it does have firewall rules, routing, and VPN. These prerequisites are not necessarily required for all Google Cloud Platform services. Google BigQuery, for example, does not require a network because it is a managed service.

> Most of the networking entities in Google Cloud Platform, such as load balancers, firewall rules and routing tables, have global scope. More importantly, networks themselves have a global scope. This means that you can create a single private IP space that is global, without having to connect multiple private networks, with the operational overhead of having to manage those spaces separately. Due to this single, global network, all of your instances are addressable within your network by both IP address and name.

> Another major difference between Google Cloud Platform networking and Elastic Compute Cloud-VPC is the concept of Live Migration. Under normal circumstances, all hardware in any data center—including Google—will eventually need either maintenance or replacement. There are also unforeseen circumstances that can happen to hardware that can cause it to fail in any number of ways. When these events happen at Google, Cloud Platform has the ability to transparently move virtual machines from affected hardware to hardware that is working normally. This is done without any interaction from the customer.

From: https://cloud.google.com/docs/google-cloud-platform-for-aws-...

Re: Spotify moves its back end to Google Cloud

#125
post #102

In the same way that facebook shut down parse, I am afraid that google is going to shut down google cloud. And reluctantly have become okay with relying on AWS.

Except that in November, we got Diane to come take over all of our Cloud and Apps business:

http://www.nytimes.com/2015/11/20/technology/google-picks-di...

Edit: Formatting (didn't mean to quote the url)

Re: Spotify moves its back end to Google Cloud

#126
post #99

What Google Cloud needs is a better sales story. AWS consistently beats out Google in this respect. This story is welcomed and there should be more success stories published like this. My business is a heavy GC user (AppEngine, Datastore, CloudStorage, BQ, ComputeEngine, ManagedVM) and I couldn't imagine achieving what we have achieved in such a short amount of time on any other platform. We (myself and another guy)…

The main reason I tend to shy away from GC is that it's blocked in China. AWS isn't (which also means Heroku isn't blocked since Heroku runs on AWS, so I use AWS for IaaS and Heroku for PaaS). If you plan to offer multi-lingual content, anticipate having viewers in that part of the world, and your content isn't something they would be interested in blocking, it's just a practicality worth factoring in. Another reason…

In my experience (3 months in Shanghai at the end of last year) AWS does occasionally get blocked or severely slowed down in China. I'd say it was inaccessible about 5% of the time (for significant periods of time).

You can of course run in the AWS Beijing region which requires you to have a Chinese business presence with a ICP license.

It'll be interesting to see what happens now that Google is expanding its presence in China [1]. I ran into some Googlers on the Maps team while in Shanghai - not likely a coincidence.

[1]: http://www.bbc.com/news/technology-34698642

Re: Spotify moves its back end to Google Cloud

#127

What Google Cloud needs is a better sales story. AWS consistently beats out Google in this respect. This story is welcomed and there should be more success stories published like this. My business is a heavy GC user (AppEngine, Datastore, CloudStorage, BQ, ComputeEngine, ManagedVM) and I couldn't imagine achieving what we have achieved in such a short amount of time on any other platform. We (myself and another guy)…

I've been relying on multiple Cloud offerings (including PaaS, IaaS etc) outside Google for many years, but for some unclear reason, I cannot manage to consider Google a reliable partner for a type of hosting or another, at this point. I would love to be proven wrong really, because I often look at their GC offering, and I /really/ want to dive in, yet I feel that I would risk having to migrate quickly in 2 weeks at…

I wonder how big you'd have to be to get a real SLA from Google, Azure, or AWS. I imagine 25% off your hosting bill doesn't really cut it for those companies running millions of dollars in revenue through it.

Re: Spotify moves its back end to Google Cloud

#128
post #22

Earlier quoted context omitted.

I've only really looked at Spotify and Tidal, but Spotify is really good. There's more to streaming than content. Makes me curious about how good Google's recommendation engine is.

As a long time Spotify user who switched to Google a few months ago: I really like the playlists and I've found a lot of new music that I like. The recommendations have worked really well. I'm not looking back.

I've also found that Google's radio stations are more diverse and less repetitive.

Re: Spotify moves its back end to Google Cloud

#129
post #95

Earlier quoted context omitted.

Depends on your standard of living. A studio apartment there goes for around $2500/month these days with no parking or utilities. Agreed that remote would be a nice option.

Paying $2500/mo for rent alone on a $50k salary is crazy.

That's why no one does it. They have roommates

Re: Spotify moves its back end to Google Cloud

#130
Sorry but spotify's infrastructure is not a shiny beacon of correctness.

They've compounded mistake upon "Oooshiny lets use that"

here is a post where someone dissects spotify's infrastructure bit by bit: http://www.secretbatcave.co.uk/software/docker-and-you/

This isn't an anti google compute, its got some really great features. But, spotify's backend infrastructure ain't one

Yes, I appreciate that that post is from a while ago, and they might have completely paid back that massive technical debt/innovation token debt.

Post reply on HN