Homomorphically encrypted CIFAR-10 inference in 200ms
sofar.belfortlabs.cloud
Homomorphically encrypted CIFAR-10 inference in 200ms
1–10 of 45 posts
Re: Homomorphically encrypted CIFAR-10 inference in 200ms
#2It's pretty confident this calculator is a cat.
https://i.postimg.cc/90WGjk8t/results.png
What's the use case for this?
Re: Homomorphically encrypted CIFAR-10 inference in 200ms
#3It's pretty confident this calculator is a cat. https://i.postimg.cc/90WGjk8t/results.png What's the use case for this?
From the webpage:
> Image classification without the server seeing the image.
The value is in being able to get the prediction from the model without ever giving unencrypted data to somebody you don’t trust.
You could have an LLM generate code for you without ever giving the operator your proprietary source code.
Re: Homomorphically encrypted CIFAR-10 inference in 200ms
#4It's pretty confident this calculator is a cat. https://i.postimg.cc/90WGjk8t/results.png What's the use case for this?
Consider encrypted AI. You ask a question under encryption. The remote calculates the answer, which is still under encryption. This is the critical point; the remote cannot see the question and answer. It only calculates. Once you receive the answer, you decrypt it and see the answer; only you see the answer.
Re: Homomorphically encrypted CIFAR-10 inference in 200ms
#5Big if true! One of the caveats here is that the file size seems to balloon 341 times.
Re: Homomorphically encrypted CIFAR-10 inference in 200ms
#6It's pretty confident this calculator is a cat. https://i.postimg.cc/90WGjk8t/results.png What's the use case for this?
I think calculator is not part of the labels in cifar-10. Pretty normal as it has ‘only’ 90% accuracy. Things could improve quickly though
Re: Homomorphically encrypted CIFAR-10 inference in 200ms
#7It's pretty confident this calculator is a cat. https://i.postimg.cc/90WGjk8t/results.png What's the use case for this?
Consider encrypted AI. You ask a question under encryption. The remote calculates the answer, which is still under encryption. This is the critical point; the remote cannot see the question and answer. It only calculates. Once you receive the answer, you decrypt it and see the answer; only you see the answer.
Ah, that sounds impossible. Good luck, sir...Also, who wants this if you can just run a local model?
Re: Homomorphically encrypted CIFAR-10 inference in 200ms
#8Earlier quoted context omitted.
Consider encrypted AI. You ask a question under encryption. The remote calculates the answer, which is still under encryption. This is the critical point; the remote cannot see the question and answer. It only calculates. Once you receive the answer, you decrypt it and see the answer; only you see the answer.
Ah, that sounds impossible. Good luck, sir...Also, who wants this if you can just run a local model?
Thanks a lot. Though encrypted AI chat bot is not far ahead, do not think of that as the primary target of today. Instead, there are many untapped applications (e.g. inter-bank transfers, industry, healthcare) where regulations, privacy laws and compliance requirements restrict institutions from touching data. These will initially be our key enablers, and over time we hope to extend the range of applications.
Re: Homomorphically encrypted CIFAR-10 inference in 200ms
#9Earlier quoted context omitted.
Consider encrypted AI. You ask a question under encryption. The remote calculates the answer, which is still under encryption. This is the critical point; the remote cannot see the question and answer. It only calculates. Once you receive the answer, you decrypt it and see the answer; only you see the answer.
Ah, that sounds impossible. Good luck, sir...Also, who wants this if you can just run a local model?
It'll be very useful for even local setups when the data needs to be confidential. Look at the research related to medical training of llms (ignore their current lack of direct usefulness/trustworthiness, those are potentially solvable), with a homomorphically encrypted session, the large inference servers never see hipaa protected data in a way that exposes it if the server is compromised even if its an on premises setup in your doctors office processing the data, reducing risk of the data leaking anywhere.
Re: Homomorphically encrypted CIFAR-10 inference in 200ms
#10Big if true! One of the caveats here is that the file size seems to balloon 341 times.
That's a exceptional tradeoff. Even 3000x is noteworthy as long as processing time does not go to the moon wrt HE/FHE