Live data from Hacker News

How and Why Swiftype Moved from EC2 to Real Hardware

highscalability.com

121–130 of 194 posts

Re: How and Why Swiftype Moved from EC2 to Real Hardware

#121

In my experience firewalls and network is more expensive than servers.... Anyone offer competition to VPC?

Softlayer manages the network for us. They offer a fully isolated backend network (frontend connection to the world is optional). For frontend connections we simply use iptables.

Re: How and Why Swiftype Moved from EC2 to Real Hardware

#122

Earlier quoted context omitted.

Now we get to the technical debt debate. Sometimes, you have to make good decisions now instead of perfect decisions later. The market doesn't care how elegant your code is.

The market cares about uptime, and cost relative to return. Perfect should never be the enemy of the good.

> Perfect should never be the enemy of the good.

Only in a world where resources are infinite does this work.

Re: How and Why Swiftype Moved from EC2 to Real Hardware

#123

RunAbove from OVH seems to be the best of both worlds. You can rent dedicated hardware by the hour for very reasonable prices.

AFAIK Softlayer has hourly-based rental for real hardware as well. Never tried that, so could not comment on it though.

Re: How and Why Swiftype Moved from EC2 to Real Hardware

#124
A concrete example of how I saved a few hundred thousand dollars over the AWS by building quarter rack colocation setups with SuperMicro servers: https://gist.github.com/rockymadden/5561377

With Ansible, I spend no more than an hour a week, amortized, maintaining both the hardware and administration. I assume nodes for any specific role will fail, I only scale horizontally, I always have redundancy for every role, I stay off disk as long as possible (heya 512GB RAM redis cluster), etc.

Re: How and Why Swiftype Moved from EC2 to Real Hardware

#125

Earlier quoted context omitted.

Yes, but engineering is cheaper than running after real-time problems.

Now we get to the technical debt debate. Sometimes, you have to make good decisions now instead of perfect decisions later. The market doesn't care how elegant your code is.

No debate, I agree with everything you have said. But sometimes you have to clean that garbage up because it does matter to the market.

Re: How and Why Swiftype Moved from EC2 to Real Hardware

#126
post #61

There's not much need for a fancy article on a fancy website in order to understand a key concept of cloud computing: Cloud computing offers you the great and awesome advantages of being able to instantly scale your application, replicate your data and basically just grow according to your business volume, and all this without significant investments, delivery time, setup time, people time, maintenance or anything bu…

> There's not much need for a fancy article on a fancy website in order to understand a key concept of cloud computing: I wish it were true, but plenty of companies are gripped by cloud fever. I've seen quite a few going down the route of charging into the cloud not because they've run the numbers and found it stacks up, but because they want to be in the cloud, and Amazon have some great marketing people.

Sounds akin to the outsourcing binge that went on a decade (?!) or so back.

Back then it seemed most companies did it not because they had done the numbers, but because a few big names had done it and so the others did it to apparently piggy back on the stock markets attention.

Re: How and Why Swiftype Moved from EC2 to Real Hardware

#127
post #105
post #89

Earlier quoted context omitted.

> Your operational overhead will increase _a lot_. Be ready to hire on a lot of ops staff if you expect them to do anything but put out fires. And as you grow you'll need experts, people like network engineers. Why? What are you talking about? You are hiring servers you are no colo'ing them. Networking them is not your problem. Your responsibility still starts from a root prompt just there's no VM layer between that…

and if you have more than one? or more than one dc? somebody needs to connect it, or you will need a VPN. it's not that easy without Clouds if you need connected servers. We switched to AWS since connecting servers in a dc isn't as cheap as people think of.

This article was talking about renting servers from Softlayer. All servers on your account in Softlayer have a private VLAN that connects them, even between data centers. Private networks for your servers are a feature of many server hosts.

Re: How and Why Swiftype Moved from EC2 to Real Hardware

#128

Earlier quoted context omitted.

Could you please list some competitors to SoftLayer? It's hard to get reliable opinions on cloud providers backed up with actual experience. I'd really appreciate it!

My personal experience within the last 7 years: * Softlayer – the best option in terms of quality of service, quality of hardware, quality and size of the infrastructure (geo distribution, etc). * Rackspace – nice, until you grow enough to get relatively locked in and then your prices start to go up, provisioning time suffers and their service turns into shit. * Steadfast – provisioning times up to a week, basically…

Hetzner and OVH both use cheap hardware, but IME it's not hard to use the same primitives you'd otherwise use in something like AWS to build in redundancy at a price point well below AWS.

I wouldn't want to do it, which is why I'd rather work for somebody who'd pay for AWS, but I think there's a thing in there somewhere for those who want to dig.

Re: How and Why Swiftype Moved from EC2 to Real Hardware

#129
post #61

There's not much need for a fancy article on a fancy website in order to understand a key concept of cloud computing: Cloud computing offers you the great and awesome advantages of being able to instantly scale your application, replicate your data and basically just grow according to your business volume, and all this without significant investments, delivery time, setup time, people time, maintenance or anything bu…

> There's not much need for a fancy article on a fancy website in order to understand a key concept of cloud computing: I wish it were true, but plenty of companies are gripped by cloud fever. I've seen quite a few going down the route of charging into the cloud not because they've run the numbers and found it stacks up, but because they want to be in the cloud, and Amazon have some great marketing people.

Often times companies move because their organization doesn't deliver, and the hope is a cloud company will do a better job of it.

If you have a great team, I firmly believe hosting yourself is far, far, far less expensive.

If you have a terrible team, then cloud (hosting) is less expensive. Even if it was exactly the same cost, you're gaining by not having to have a staff to run it, and the costs of managing them, etc etc.

Most places don't have great teams. Insert random corporation here likely has a team that is a mess for whatever reasons happen in large companies.

In that case, the Cloud makes a ton of sense for them. They've already screwed up their own organization in some way, and this is a large reset button on the whole thing.

That's worth a ton in itself.

Re: How and Why Swiftype Moved from EC2 to Real Hardware

#130

I'm telling you theres real opportunity for someone to create "the Uber of colocation/dedicated hosting".

OpenStack was supposed to facillitate this. Doesn't seem to get much use.

It does from my perspective. I could list many companies that use it for major things.

It doesn't always get publicity. I work for a major company, and we don't scream from the roof tops about it.

Post reply on HN