Off-topic: whenever I see (YC ) in a title I always assume it's a job posting and automatically ignore it. Might be detrimental to label a blog post appear that way.
Better to read it as advertising YC's investments on YC's forum.
ZeroDB (YC S16) Provides Security for Enterprise Big Data in the Cloud
11–20 of 38 posts
Re: ZeroDB (YC S16) Provides Security for Enterprise Big Data in the Cloud
#12As the founding engineer at VoltDB, I can tell you that no matter how cool your name is, it can be annoying to be always alphabetized last.
That's one of the reasons behind the name change from Cadabra to Amazon.com.
p.s. if you change it to 0db perhaps you might be listed before any "a" company? Not sure if numbers precede letters in those lists.
Re: ZeroDB (YC S16) Provides Security for Enterprise Big Data in the Cloud
#13Whitepaper from Arxiv describing their scheme for others who like seeing underlying details of security tech:
https://arxiv.org/pdf/1602.07168v3.pdf
@ ZeroDB developers
I know the goal is to have the cloud provider untrusted in this model for storage/processing. However, have you considered them actively malicious in how they handle the protocol steps with the on-site client? As in, at each step (eg a query), they might try to attack the protocol or especially the implementation (a la OpenSSL infamy). Just make sure you have defenses for that sort of thing.
Re: ZeroDB (YC S16) Provides Security for Enterprise Big Data in the Cloud
#14As the founding engineer at VoltDB, I can tell you that no matter how cool your name is, it can be annoying to be always alphabetized last.
That's one of the reasons behind the name change from Cadabra to Amazon.com. p.s. if you change it to 0db perhaps you might be listed before any "a" company? Not sure if numbers precede letters in those lists.
0db - that's I was thinking of. Way to fight 0days
Re: ZeroDB (YC S16) Provides Security for Enterprise Big Data in the Cloud
#15The biggest technical hurdle for this type of database right now is index lookup. Since the nodes on the indexes are encrypted the client/server requires a round trip for every binary tree index level that needs to be traversed. This makes what is usually one of the fastest database operations into a slow one.
This is indeed true for our standalone, open source database (https://github.com/zerodb/zerodb).
However, it is not the case for our Hadoop scheme (nor our future support for structured database). In these cases, there is no round-tripping required. In fact, it's significantly more performant than existing Transparent Data Encryption in Hadoop, from both a latency and key rotation perspective.
We'll likely release a paper describing this new scheme later in the year as well as publish at some conferences.
Re: ZeroDB (YC S16) Provides Security for Enterprise Big Data in the Cloud
#16The biggest technical hurdle for this type of database right now is index lookup. Since the nodes on the indexes are encrypted the client/server requires a round trip for every binary tree index level that needs to be traversed. This makes what is usually one of the fastest database operations into a slow one.
This is indeed true for our standalone, open source database ( https://github.com/zerodb/zerodb ). However, it is not the case for our Hadoop scheme (nor our future support for structured database). In these cases, there is no round-tripping required. In fact, it's significantly more performant than existing Transparent Data Encryption in Hadoop, from both a latency and key rotation perspective. We'll likely release…
That will be a very interesting read.
Re: ZeroDB (YC S16) Provides Security for Enterprise Big Data in the Cloud
#17Hey HN, cofounder of ZeroDB here. Michael (/u/michwill) and I are excited to be a part of YC and happy to answer any questions about the company!
Love the idea behind ZeroDB - kudos to you guys, and cheers from a fellow Tar Heel!
What's your expansion strategy for Oracle/DB2/MySQL?
Re: ZeroDB (YC S16) Provides Security for Enterprise Big Data in the Cloud
#18Hey HN, cofounder of ZeroDB here. Michael (/u/michwill) and I are excited to be a part of YC and happy to answer any questions about the company!
Lol k
- michael scott
Re: ZeroDB (YC S16) Provides Security for Enterprise Big Data in the Cloud
#19For those who may know, how does ZeroDB stack up against an incumbent like MarkLogic in the 'Security for Enterprise Big Data in the Cloud'?
Re: ZeroDB (YC S16) Provides Security for Enterprise Big Data in the Cloud
#20Whitepaper from Arxiv describing their scheme for others who like seeing underlying details of security tech: https://arxiv.org/pdf/1602.07168v3.pdf @ ZeroDB developers I know the goal is to have the cloud provider untrusted in this model for storage/processing. However, have you considered them actively malicious in how they handle the protocol steps with the on-site client? As in, at each step (eg a query), they mi…
Malicious server, apart from possibility of removing data, would look pretty unusual for the client (like returning incorrect data etc). So it's a good idea to look for these patterns. An attack would probably look like trying to use the client as an oracle, and that's pretty detectable.
But as MacLane pointed out in another comment this is only the case for the standalone database described in the ArXiv paper. The Hadoop scheme works quite differently