Love it! We are unfortunately moving away from self-hosted bare metal. I disagree with the transition to AWS. But it's been made several global layers above me. It's funny our previous AWS spend was $800 per month and has been for almost 6 years. We've just migrated some of our things to AWS and the spend is around $4,500 per month. I've been told the company doesn't care until our monthly is in excessive of five fig…
Migrating from AWS to Hetzner
211–220 of 643 posts
Re: Migrating from AWS to Hetzner
#212Can anyone recommend a good cloud for GPU instances? Was trying to find a good one for 30B quants but there’s so many now and the pricing is all over the place.
Re: Migrating from AWS to Hetzner
#213Re: Migrating from AWS to Hetzner
#214I cannot overstate the performance improvement of deploying onto bare metal. We typically see a doubling of performance, as well as extremely predictable baseline performance. This is down to several things: - Latency - having your own local network, rather than sharing some larger datacenter network fabric, gives around of order of magnitude reduced latency - Caches – right-sizing a deployment for the underlying har…
> If you don't want to do this yourself, then we'll do it for you for half the price of AWS (and we'll be your DevOps team too You might not realize but you are actually increasing the business case for AWS :-) Also those hardware savings will be eaten away by two days of your hourly bill. I like to look at my project costs across all verticals...
Re: Migrating from AWS to Hetzner
#215I cannot overstate the performance improvement of deploying onto bare metal. We typically see a doubling of performance, as well as extremely predictable baseline performance. This is down to several things: - Latency - having your own local network, rather than sharing some larger datacenter network fabric, gives around of order of magnitude reduced latency - Caches – right-sizing a deployment for the underlying har…
What is old is new again. My employer is so conservative and slow that they are forerunning this Local Cloud Edge Our Basement thing by just not doing anything.
Over the years I tried occasionally to look into cloud, but it never made sense. A lot of complexity and significantly higher cost, for very low performance and a promise of "scalability". You virtually never need scalability so fast that you don't have time to add another server - and at baremetal costs, you're usually about a year ahead of the curve anyways.
Re: Migrating from AWS to Hetzner
#216It was never about price or performance. Price and performance may be things you care about as a hobbyist, but as a business you have a lot of other considerations.
Re: Migrating from AWS to Hetzner
#217Earlier quoted context omitted.
What is old is new again. My employer is so conservative and slow that they are forerunning this Local Cloud Edge Our Basement thing by just not doing anything.
As an infrastructure engineer (amongst other things), hard disagree here. I realize you might be joking, but a bit of context here: a big chunk of the success of Cloud in more traditional organizations is the agility that comes with it: (almost) no need to ask permission to anyone, ownership of your resources, etc. There is no reason that baremetal shouldn't provide the same customer-oriented service, at least for th…
In a large enough org that experience doesn’t happen though - you have to go through and understand how the org’s infra-as-code repo works, where to make your change, and get approval for that.
Re: Migrating from AWS to Hetzner
#218I've been running my SaaS on Hetzner servers for over 10 years now. Dedicated hardware, clusters in DE and FI, managed through ansible. I use vpncloud to set up a private VPN between the servers (excellent software, btw). My hosting bill is a fraction of what people pay at AWS or other similar providers, and my servers are much faster. This lets me use a simpler architecture and fewer servers. When I need to scale, I…
Re: Migrating from AWS to Hetzner
#219Are there decent US based alternatives to Hetzner? I'd like to have my servers located in the US for a variety of reasons, but most of the alternatives I've seen to Hetzner seem to be pretty fly-by-night shops.
Hetzner has 2 DCs in the US with solid peerings and transit.
Re: Migrating from AWS to Hetzner
#220Earlier quoted context omitted.
There is a graph database which does disk IO for database startup, backup and restore as single threaded, sequential, 8kb operations. On EBS it does at most 200MB/s disk IO just because the EBS operation latency even on io2 is about 0.5 ms. Even though the disk can go much faster, disk benchmarks can easily do multi-GB/s on nodes that have enough EBS throughput. On instance local SSD on the same EC2 instance it will…
What graph db is that?