Live data from Hacker News

AWS S3 open source alternative written in Go

minio.io

121–130 of 139 posts

Re: AWS S3 open source alternative written in Go

#121

Earlier quoted context omitted.

There really are pros to on prem. There are cons, don't get me wrong, but to somehow claim that AWS is the end all be all of hosting choices is demonstrably wrong. For example - You want to develop a financial exchange with a 100 microsecond average response time, peaks of 10Gbit traffic, and 5 9s of uptime. Do you host that on AWS? I wouldn't. Another example - If I were a medium+ sized company (say 20+ employees),…

Re: github I can understand why on-premises git is better in some ways. But you're overstating the frequency of github outages. And it doesn't exactly kill the business when it's down for an hour. Git is distributed after all.

> But you're overstating the frequency of github outages.

It's a little of topic, but I don't think it's overstated. People complain about the stability of something like HipChat all the time, but GitHub is unavailable more often, in our area at least.

GitHub is huge target, and outages are extremely disruptive for companies.

Re: AWS S3 open source alternative written in Go

#123
post #72

Earlier quoted context omitted.

On-Premises is also "one less third-party service to manage". I work for a small company, and was asked to list the external services we use a couple of days ago, and the list went into dozens. It's not the primary reason for On Premises, but it's one less thing to worry about: "our tech team has full control, instead of yet another company having some control that we can't see"

I would argue that from a management point of view it's actually a lot nicer for small places to offload to third parties. As a point, my original comment pointed out that somebody else is on-call for that services uptime.

I agree with you; outsourcing those services certainly helps this one-man ops team. But for a larger company with a more mature and staffed ops team, there's going to be that advantage above.

Re: AWS S3 open source alternative written in Go

#124
post #117

Earlier quoted context omitted.

Other alternatives: ceph - http://docs.ceph.com/docs/master/radosgw/s3/ swift - https://wiki.openstack.org/wiki/Swift/APIFeatureComparison#A...

CEPH is a volume service not an object storage service. SWIFT is indeed analogous to S3.

Come on, I literally linked to a website describing "CEPH OBJECT GATEWAY S3 API"

Re: AWS S3 open source alternative written in Go

#125

Earlier quoted context omitted.

I've been wondering about this for that use case myself: https://ipfs.io/

Yea IPFS is awesome, i have often pondered about the idea of using it for an internal family storage.

Does it support encryption yet? Also, you'd have to auto-pin all your files, or risk losing them.

I think GlusterFS (battle-proof, but file-wise and assumes an administrator with access to everything) assumes or infinit.sh (robust ACL, but young, not open-source) better addresses those use-cases.

Re: AWS S3 open source alternative written in Go

#126

Earlier quoted context omitted.

Yea IPFS is awesome, i have often pondered about the idea of using it for an internal family storage.

Does it support encryption yet? Also, you'd have to auto-pin all your files, or risk losing them. I think GlusterFS (battle-proof, but file-wise and assumes an administrator with access to everything) assumes or infinit.sh (robust ACL, but young, not open-source) better addresses those use-cases.

Encrypt the files before adding to IPFS and then decrypt after receiving them. Support for encryption will be built-in into IPFS in the future but for now, this solution works. There is a issue tracking this here: https://github.com/ipfs/faq/issues/6

Also, when adding files yourself, those files become pinned by the default. Getting files won't pin automatically however. You have some more information about pinning here: https://github.com/ipfs/examples/tree/master/examples/pinnin...

Re: AWS S3 open source alternative written in Go

#127
post #126

Earlier quoted context omitted.

Does it support encryption yet? Also, you'd have to auto-pin all your files, or risk losing them. I think GlusterFS (battle-proof, but file-wise and assumes an administrator with access to everything) assumes or infinit.sh (robust ACL, but young, not open-source) better addresses those use-cases.

Encrypt the files before adding to IPFS and then decrypt after receiving them. Support for encryption will be built-in into IPFS in the future but for now, this solution works. There is a issue tracking this here: https://github.com/ipfs/faq/issues/6 Also, when adding files yourself, those files become pinned by the default. Getting files won't pin automatically however. You have some more information about pinning h…

Ah, good to know. Still, you end up having to develop your own ACL system if you have multiple users (eg. family). Especially, shared directories are tricky.

Re: AWS S3 open source alternative written in Go

#128
post #47

Or, run Riak with their S3 compatibility layer. Riak is extremely stable and the work Basho has done to make a truly robust distributed database is significant. http://docs.basho.com/riak/cs/2.1.1/

+1 on RiakCS. They now call it RiakS2 for kicks. The scalability and reliability of their server is insane. You just can't beat Erlang software in that regard. Unfortunately, Basho has been so successful with their TSDB and KV products that they have basically put S2 on maintenance mode. They are still "supporting" it, but no new features. I was hoping this Minio tool could do something similar, but with a single dae…

Another interesting project written in Erlang is LeoFS: http://leo-project.net/leofs/

Re: AWS S3 open source alternative written in Go

#129
post #87
post #83

Earlier quoted context omitted.

Then why not make the license AGPLv3-or-later, to avoid other people creating proprietary forks? I get that it's not a common occurence within the Golang world, but nothing will change unless more Golang projects start making their code copylefted.

GNU AGPL is an ideal license for free software projects. We are a strong supporter of the GNU project. We chose Apache License for Minio purely for adoption reasons. Most of our users build proprietary software around Minio and their legal council has a default NO policy towards GNU licenses. Besides, FSF has also approved Apache License v2 as a free software license. Proprietary forks are OK with us. It will be too…

> It will be too expensive to maintain branches of their own and catch up with the upstream.

Haha, you guys are awesome! You've totally figured it out. Stay awesome!

Post reply on HN