Do you think there is a market for zero knowledge Natural Language Model APIs. For example, a Natural Language Understanding model that provides a public key to encrypt the data/prompt before sending and which runs within a secure isolated environment (like AWS Nitro) which has exclusive access to the decryption keys?
Ask HN: Is there a market for zero-knowledge API's?
1–10 of 19 posts
Re: Ask HN: Is there a market for zero-knowledge API's?
#2How would I use it in the real world?
Re: Ask HN: Is there a market for zero-knowledge API's?
#3Yes absolutely!
Re: Ask HN: Is there a market for zero-knowledge API's?
#4How would I use it in the real world?
exactly as any existing API, it's just that you would encrypt the prompt with the API public key before querying the API; since it's running in a secure enclave environment, it is highly secure. My idea is that this could be interesting for applications that are sensitive but would benefit from AI features. For example, providing sentiment analysis for a journaling application (private journal entries)
Re: Ask HN: Is there a market for zero-knowledge API's?
#5How would I use it in the real world?
exactly as any existing API, it's just that you would encrypt the prompt with the API public key before querying the API; since it's running in a secure enclave environment, it is highly secure. My idea is that this could be interesting for applications that are sensitive but would benefit from AI features. For example, providing sentiment analysis for a journaling application (private journal entries)
Yes that’s hot stuff.
Re: Ask HN: Is there a market for zero-knowledge API's?
#6It's not sexy sounding but I just had to implement something similar, in house, for some BI workloads involving HR data for our people team. I had to ensure that I nor any other infra person would be able to backdoor and view any of the data or decrypt anything. I think this is another space where this could be very useful.
Re: Ask HN: Is there a market for zero-knowledge API's?
#7It's not sexy sounding but I just had to implement something similar, in house, for some BI workloads involving HR data for our people team. I had to ensure that I nor any other infra person would be able to backdoor and view any of the data or decrypt anything. I think this is another space where this could be very useful.
interesting, how did you end up implementing this?
Re: Ask HN: Is there a market for zero-knowledge API's?
#8Related q: I had a commercial dataset that I would loved to have found a way of verifiably locking access down to but still allowing my customers to consume it for model training etc.
Anyone come across such a thing?
Re: Ask HN: Is there a market for zero-knowledge API's?
#9Related q: I had a commercial dataset that I would loved to have found a way of verifiably locking access down to but still allowing my customers to consume it for model training etc. Anyone come across such a thing?
that sounds difficult. Is it possible? Once the customer has access to the data, how can you guarantee they don't copy it?
Re: Ask HN: Is there a market for zero-knowledge API's?
#10How would I use it in the real world?
exactly as any existing API, it's just that you would encrypt the prompt with the API public key before querying the API; since it's running in a secure enclave environment, it is highly secure. My idea is that this could be interesting for applications that are sensitive but would benefit from AI features. For example, providing sentiment analysis for a journaling application (private journal entries)
Would this work in a way that could keep data on the customers' premises? I often use CUI (Confidential/Controlled Unclassified Information) or classified information, and I'm thinking this would be really big for such applications, but you'd need to be seriously secure to meet MIL standards. Then there is obviously a lot of corporate info or banking info with different but similarly high standards...
This is certainly a great start securing the comms - good fortune putting it all together!