41–50 of 139 posts
Earlier quoted context omitted.
So far the best option I've found has been GlusterFS
Minio is by ex-GlusterFS developers!
That gives it some credibility. Especially ability to deal with tough challenges they'll encounter in this domain. Helps to have encountered most already. ;) I'll look at it in more detail later on. I'm also more interested in it if it has many-node, HA/SSI support. What's ETA on that feature?
Sorry for two posts (the other one was unrelated). If anyone has experience with this I have a few questions regarding a particular use case. How does something like this behave with really large files. Video files in 100s of gigabytes, for example. I'm asking because if one could set up a resilient online (online as in available) storage with fat pipes like this it could be used as a platform to build a centralized…
It's a bit confusing, but minio is not a resilient storage. It's just a server, kind of like webdav, but with s3 api and a capability to use multiple filesystem folders with erasure coding. As for distributed object storages, I would expect them to work great for video editing, since they can saturate any link given enough servers. But not out of the box, you would need a client designed for it, splitting files into…
Currently available minio is resilient to disk failures using erasure coding (similar to RAID)
Earlier quoted context omitted.
I use Swift at work, and while it is a great tool, it is a bitch to set up. I would be curious to learn how Minio works more technically on a distributed level: how is object replication handled? are downloads automatically routed to the closest server? can I make downloads temporarily available (think Swift tempURLs)?
We are currently working on the distributed version and will be making a beta release soon. Currently minio supports - pure FS backend with single disk - pure Erasure coded backend with multiple disks on single node (like ZFS) For more information you can read here - https://docs.minio.io/docs/minio-erasure-code-quickstart-gui... We do not do any sort of replication erasure code handles disk failures and we also impl…
Relevant docs here https://docs.minio.io/docs/using-pre-signed-urls-to-download...
Earlier quoted context omitted.
I think these days we should by default think of storing blobs of data (like video files) in storage systems like S3 or the alternatives, and that ordinary filesystems should be thought of as a special case where you want to attach storage to an individual computer. Edit: I'm going to elaborate, because people are calling me naïve. Full disclosure: I work at a cloud provider on a storage team. For most people and app…
Uhhh have you seen the internet data transfer costs for S3? That would become absurdly expensive quickly. Even with a dedicated cross connect.
Earlier quoted context omitted.
Minio is by ex-GlusterFS developers!
"You had my curiosity but now you have my attention." That gives it some credibility. Especially ability to deal with tough challenges they'll encounter in this domain. Helps to have encountered most already. ;) I'll look at it in more detail later on. I'm also more interested in it if it has many-node, HA/SSI support. What's ETA on that feature?
We are also about to finish distributed server functionality you can track the work here https://github.com/minio/minio/tree/distributed
Smart.
Earlier quoted context omitted.
"You had my curiosity but now you have my attention." That gives it some credibility. Especially ability to deal with tough challenges they'll encounter in this domain. Helps to have encountered most already. ;) I'll look at it in more detail later on. I'm also more interested in it if it has many-node, HA/SSI support. What's ETA on that feature?
Currently we have a single node multi disk version relevant docs here - https://docs.minio.io/docs/minio-erasure-code-quickstart-gui... We are also about to finish distributed server functionality you can track the work here https://github.com/minio/minio/tree/distributed