Live data from Hacker News

Highly Available Block Storage

digitalocean.com

111–120 of 145 posts

Re: Highly Available Block Storage

#111
post #108
post #105

Earlier quoted context omitted.

hence when a DMCA takedown is received, i don't see how DO is in a position to assess that something is or is not a violation. they simply follow the process outlined in the legislation.

An that process has a provision for the customer to file a dispute and this obsolves the host and sends the matter to court. Ot did you Miss that comment?

sure, a claim can in turn result in a counter claim. i'm not sure why you're asking if i missed such a comment.

Re: Highly Available Block Storage

#112
post #93

Earlier quoted context omitted.

My guess is that they live migrate VMs only before a planned maintenance. Let's say they use a 10 Gbps network, and they use only 1 Gbps of bandwidth for migrating data, then migrating a 200 GB disk would take something like 1 hour, which sounds OK. Can you share some details about your experience?

You're missing a subtlety: it's a live migration. You've also got to migrate the data the VM's writing while the migration is going on. Depending on how your network's set up, it might well be possible for the VM to saturate out the migration process. Plus this won't only be planned maintenance, it'll be to get off dodgy hardware, too, including spannered RAID controllers where you really don't want to risk hanging a…

Thanks a lot for your detailed answer. I understand your arguments, but Google Compute Engine Local SSDs support live migration [1], which seems to prove it's possible, despite the difficulties. Any advice about this?

[1] https://cloud.google.com/compute/docs/disks/#data_persistenc...

Re: Highly Available Block Storage

#113

Earlier quoted context omitted.

You're missing a subtlety: it's a live migration. You've also got to migrate the data the VM's writing while the migration is going on. Depending on how your network's set up, it might well be possible for the VM to saturate out the migration process. Plus this won't only be planned maintenance, it'll be to get off dodgy hardware, too, including spannered RAID controllers where you really don't want to risk hanging a…

Thanks a lot for your detailed answer. I understand your arguments, but Google Compute Engine Local SSDs support live migration [1], which seems to prove it's possible, despite the difficulties. Any advice about this? [1] https://cloud.google.com/compute/docs/disks/#data_persistenc...

Yeah, it's possible. Just not pleasant. What they're doing (and how unpleasant it is to operate) will depend on exactly what they mean by:

> Your instance might experience a short period of decreased performance

and how tolerant they are of unplanned reboots. I suspect what it means is that they'll throttle your VM (or maybe pause your IO) so it can't interfere with finalising the migration.

That being said, this is Google. They've probably thrown more man-hours at this than anyone else would think sane. I'll note that this is in the context of automatic migration away from "maintenance events" (whatever that covers) - it sounds like they think they've automated away a lot of the reasons we were having to keep an eye on things, but they're still vulnerable to hardware failure (obviously).

Re: Highly Available Block Storage

#114
post #106
post #45

Earlier quoted context omitted.

Reminder that you have to act on abuse notifications sharpish. You're providing a service, it's on you if you ignore abuse notifies. "We received notice on behalf of a trademark holder that a customer of DigitalOcean was hosting infringing content on our network. DigitalOcean immediately notified our customer of the infringement, and the customer was given a five day period to resolve the issue. The infringing conten…

The founder of surge.sh commented on this on HN and it directly conflicts with Digital Ocean's statement https://news.ycombinator.com/item?id=12010521 """ 11:02am - "you need to remove the content or fill out a counter claim" 12:47pm - "we were wrong, no counter claim can be filed and you now have 39minutes to remove the content or we are disabling the network" """ Then in the comments: """ 5 days ago we got forwarde…

> Believe who you will.

As evident in the comments beneath your link, they had been in contact with DO for ~5 days at that point. Your quote leaves out important information and is misleading at best

Re: Highly Available Block Storage

#115

Reminder that just a few weeks ago DigitalOcean rolled over on one of their customers and took down 38,000 websites after receiving a claim of infringement from the NRA against a parody site hosted on surge.sh: http://motherboard.vice.com/read/nra-complaint-takes-down-38...

DMCA takedown: the new orbital ion cannon

The surge.sh case was not a DMCA takedown, it was about a trademark infringement notice. There are no counterclaims in such cases.

Re: Highly Available Block Storage

#116

Earlier quoted context omitted.

Find me a viable candidate who will work for the people and I will.

Gary Johnson isn't as insane as the other two.

Gary Johnson is a neo-con hack. Voting for him is like barely voting for a 3rd party.

Re: Highly Available Block Storage

#117

$.10/GB block storage is too expensive. https://www.online.net/en/dedicated-server/rpn-san There are several places you can get ~5 TB for +/-10% of the 1TB price at DO. DO is offering a SAN at Object Store prices. :/

So is that service. You linked to the non SSD version. Their SSD version is $0.12/GB

Re: Highly Available Block Storage

#118
post #94
post #92

Earlier quoted context omitted.

What should be used for I/O throughput tests instead?

I usually use Bonnie++ when testing disk performance. http://www.coker.com.au/bonnie++/

The only thing worse than dd is bonnie++. Please, folks, use fio, or at least iozone, with multiple threads and/or a queue depth greater than one.

Re: Highly Available Block Storage

#119

Earlier quoted context omitted.

Ceph is not block storage -- ceph is object storage

It's fundamentally objects, but not S3-style objects. It's more NASD/T10 objects, with rich semantics including partial writes and strong consistency. Implementing block storage on top of this layer (called RADOS) is trivial. Implementing S3-style objects is a bit more work, and implementing a filesystem was downright hard, but both have been done. Disclaimer: I'm a Gluster developer, which isn't quite the same as be…

/disclaimer/disclosure/ - when you disclose something, it's a disclosure.

Re: Highly Available Block Storage

#120
post #64

Earlier quoted context omitted.

Gary Johnson isn't as insane as the other two.

Remember the old joke that I can't be a Democrat because I want to spend my own money, and I can't be a Republican because of what I want to spend my money on? If you chuckled at it, you should check Gary Johnson out. For real.

Does not support net neutrality. Game over for me.
Post reply on HN