Again, I will wait until there's a provider that doesn't train on prompts before I will benchmark.
I built TrustedRouter so this can fail closed. min_privacy=zdr rejects the request when the model has no ZDR provider; confidential requires provider-side confidential compute. https://trustedrouter.com/blog/how-confidential-computing-pr...
Is it another proxy on top? What stops the provider from reading/storing the prompts at the LLM execution level?