Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Highly Available Block Storage

digitalocean.com

Post reply on HN
Print view View original

101–110 of 145 posts

Re: Highly Available Block Storage

#101

Post by happyslobro »

Spivak wrote: post #66
unethical_ban wrote: post #54

Earlier quoted context omitted.

Gary Johnson isn't as insane as the other two.

And, assuming you don't like Hillary or Trump, the most positive thing you could do with your vote this cycle is help a 3rd party get federal funding and a national stage to promote their platform.

This is exactly why I have been voting for the Canadian green party for my entire adult life. We finally got an MP (equivalent to a senator, I think) in a few years ago, Elizabeth May. You should hear her rip into the mainstream parties in the middle of parliament, it's awesome. Harper tried passing a bunch of new laws to shut her up, but he lost an election before he could pull it off.

Re: Highly Available Block Storage

#102

Post by happyslobro »

3pt14159 wrote: post #81
Veratyr wrote: post #65

Earlier quoted context omitted.

You're looking at the wrong market. At Hetzner, you can rent a dedicated server with 2x3TB drives for about $25/month ($0.005/GB, to scale to multiple servers, use Ceph) and a few larger machines for under $100. At OVH you can buy object storage for around 1c/GB and rent a few dedicated servers for less than $100/month, or use their cloud. If you go to the _really_ low end, time4vps will give you a 1TB VPS for 2EUR/m…

Yeah, but I like the DO per hour billing, design, and API. Other than their insecure-by-default SSH key thing, https://digitalocean.uservoice.com/forums/136585-digitalocea... that is.

How many hours does it take to load 10TB and then reduce it to 5GB? ;)

Re: Highly Available Block Storage

#103

Post by pstadler »

cgag wrote: post #91

Sweet. This makes digitalocean much more appealing as a potential substrate for a kubernetes cluster.

I just migrated my Kubernetes/Rancher stack from NYC2 to NYC1 in order to use block storage. Eager to see whether this plays well with GlusterFS.

Re: Highly Available Block Storage

#104

Post by 3pt14159 »

happyslobro wrote: post #102
3pt14159 wrote: post #81

Earlier quoted context omitted.

Yeah, but I like the DO per hour billing, design, and API. Other than their insecure-by-default SSH key thing, https://digitalocean.uservoice.com/forums/136585-digitalocea... that is.

How many hours does it take to load 10TB and then reduce it to 5GB? ;)

Actually because I use the DO API and lots of small instances that work together, not that long. Right now I use S3, which blows because I hate the S3 cli and API, so I would love a better solution.

Re: Highly Available Block Storage

#105

Post by abiox »

fenomas wrote: post #84
abiox wrote: post #78

Earlier quoted context omitted.

> if it falls under fair use i'm under the impression that "fair use" is a defense and/or judge's assessment, rather than something "civilians" can factually declare.

The same is true of "violation of the copyrights, trademarks, patents or trade secrets of third parties".

hence when a DMCA takedown is received, i don't see how DO is in a position to assess that something is or is not a violation. they simply follow the process outlined in the legislation.

Re: Highly Available Block Storage

#106

Post by buckhx »

corobo wrote: post #45
bjacobel wrote: post #34

Reminder that just a few weeks ago DigitalOcean rolled over on one of their customers and took down 38,000 websites after receiving a claim of infringement from the NRA against a parody site hosted on surge.sh: http://motherboard.vice.com/read/nra-complaint-takes-down-38...

Reminder that you have to act on abuse notifications sharpish. You're providing a service, it's on you if you ignore abuse notifies. "We received notice on behalf of a trademark holder that a customer of DigitalOcean was hosting infringing content on our network. DigitalOcean immediately notified our customer of the infringement, and the customer was given a five day period to resolve the issue. The infringing conten…

The founder of surge.sh commented on this on HN and it directly conflicts with Digital Ocean's statement

https://news.ycombinator.com/item?id=12010521

"""

11:02am - "you need to remove the content or fill out a counter claim"

12:47pm - "we were wrong, no counter claim can be filed and you now have 39minutes to remove the content or we are disabling the network"

"""

Then in the comments:

"""

5 days ago we got forwarded a forward of a takedown request that was sent to CloudFlare from a representative of the trademark holder. We responded to that forward within 22 minutes of first receiving it and have been in communication with Digital Ocean ever since right up until about 1.5h prior to be shut down.

"""

Believe who you will.

Edit: added 2nd quote from comments

Re: Highly Available Block Storage

#107

Post by cvwright »

happyslobro wrote: post #101
Spivak wrote: post #66

Earlier quoted context omitted.

And, assuming you don't like Hillary or Trump, the most positive thing you could do with your vote this cycle is help a 3rd party get federal funding and a national stage to promote their platform.

This is exactly why I have been voting for the Canadian green party for my entire adult life. We finally got an MP (equivalent to a senator, I think) in a few years ago, Elizabeth May. You should hear her rip into the mainstream parties in the middle of parliament, it's awesome. Harper tried passing a bunch of new laws to shut her up, but he lost an election before he could pull it off.

In the US there's a green party candidate for president this year too, Jill Stein. Last I heard, they were able to get onto the ballot in most states.

Re: Highly Available Block Storage

#108

Post by blahi »

abiox wrote: post #105
fenomas wrote: post #84

Earlier quoted context omitted.

The same is true of "violation of the copyrights, trademarks, patents or trade secrets of third parties".

hence when a DMCA takedown is received, i don't see how DO is in a position to assess that something is or is not a violation. they simply follow the process outlined in the legislation.

An that process has a provision for the customer to file a dispute and this obsolves the host and sends the matter to court. Ot did you Miss that comment?

Re: Highly Available Block Storage

#109

Post by regularfry »

ngrilly wrote: post #93
regularfry wrote: post #77

Earlier quoted context omitted.

Then they'll run into the same problem anyone does doing that: migrating reasonably-sized block devices across a reasonable network takes an unreasonable length of time. Been there, done that, don't want to sit staring at consoles waiting for live disc migrations ever again.

My guess is that they live migrate VMs only before a planned maintenance. Let's say they use a 10 Gbps network, and they use only 1 Gbps of bandwidth for migrating data, then migrating a 200 GB disk would take something like 1 hour, which sounds OK. Can you share some details about your experience?

You're missing a subtlety: it's a live migration. You've also got to migrate the data the VM's writing while the migration is going on. Depending on how your network's set up, it might well be possible for the VM to saturate out the migration process. Plus this won't only be planned maintenance, it'll be to get off dodgy hardware, too, including spannered RAID controllers where you really don't want to risk hanging around. Add in that you're likely going to be moving sets of discs at once (so possibly a couple of TB at a time), rather than individually, and you're very quickly looking at spending a day (or a night) at a time watching in case there's a network blip which means you need to restart any of them. This does not lend itself to a peaceful, happy existence.

It doesn't take doing this very often to make you realise that this is fundamentally backwards: you want the disc data already present on more than one storage server so that if one goes pop, you're not stuffed. Once you've done that, you can make the observation that hardware RAID is no longer necessary, and save yourself a layer of complexity.

Re: Highly Available Block Storage

#110

Post by sciurus »

pepr wrote: post #92
Thaxll wrote: post #82

Earlier quoted context omitted.

Don't use dd for those tests it's really bad, especially on VMs.

What should be used for I/O throughput tests instead?

One key thing is doing active benchmarking to validate what you're testing. See an example at http://www.brendangregg.com/ActiveBenchmarking/bonnie++.html
Post reply on HN