31–40 of 106 posts
So impressive - cloud AI that is verifiable with zero trust assumptions is going to be game-changing regardless of the industry application. Looks like it could be used by anyone for making anything trustworthy.
> with zero trust assumptions It's not that though. Not close. You are trusting the chip maker, whose process is secret (actually worse, it's almost certainly shared with the state).
This approach relies too much on trust.
If you have data you are seriously sensitive about, its better for you to run models locally on air gapped instances.
If you think this is an overkill, just see what happened to coinbase of recent. [0]
[0]: https://www.cnbc.com/2025/05/15/coinbase-says-hackers-bribed...
Earlier quoted context omitted.
> with zero trust assumptions It's not that though. Not close. You are trusting the chip maker, whose process is secret (actually worse, it's almost certainly shared with the state).
We do have to trust the chip maker until open hardware catches up [1]. [1] https://news.ycombinator.com/item?id=43997856
The only way to guarantee privacy in cloud computing is via homorphic encryption. This approach relies too much on trust. If you have data you are seriously sensitive about, its better for you to run models locally on air gapped instances. If you think this is an overkill, just see what happened to coinbase of recent. [0] [0]: https://www.cnbc.com/2025/05/15/coinbase-says-hackers-bribed...
How large do you wager your moat to be? Confidential computing is something all major cloud providers either have or are about to have and from there it's a very small step to offer LLM-s under the same umbrella. First mover advantage is of course considerable, but I can't help but feel that this market will very quickly be swallowed by the hyperscalers.
This. Big tech providers already offer confidential inference today.
Earlier quoted context omitted.
We do have to trust the chip maker until open hardware catches up [1]. [1] https://news.ycombinator.com/item?id=43997856
Even if you had open hardware, how would you even know a chip you have sitting in front of you was fabricated correctly?
How large do you wager your moat to be? Confidential computing is something all major cloud providers either have or are about to have and from there it's a very small step to offer LLM-s under the same umbrella. First mover advantage is of course considerable, but I can't help but feel that this market will very quickly be swallowed by the hyperscalers.
This. Big tech providers already offer confidential inference today.
Have GCP and AWS started offering this for GPUs?
Can you talk about how this relates to / is different / is differentiated from what Apple claimed to do during their last WWDC? They called it "private cloud compute". (To be clear, after 11 months, this is still "announced", with no implementation anywhere, as far as I can see.)
Here is their blog post on Apple Security, dated June 10: https://security.apple.com/blog/private-cloud-compute/
EDIT: JUST found the tinfoil blog post on exactly this topic. https://tinfoil.sh/blog/2025-01-30-how-do-we-compare
If instead users must use your web-served client code each time, you could subtly alter that over time or per-user, in ways unlikely to be detected by casual users – who'd then again be required to trust you (Tinfoil), rather than the goal on only having to trust the design & chip-manufacturer.