Viewing profile — kevinis

Also curious about the potential users of your product, do you target individual users, small businesses, or large enterprises? Pursuing SOC2 and HIPPA make me think about the larg…

Thanks that's great to know. btw does a user need to trust Neoclouds in case they install malicious hardware/firmware/software on the servers?

Just noticed Tinfoil runs Deepseek-R1 "70b". Technically this is not the original 671b Deepseek R1; it's just a Llama-70b trained by Deepseek R1 (called "distillation").

GCP has confidential VMs with H100 GPUs; I'm not sure if Google would be interested. And they get huge discount buying GPUs in bulk. The trade-off between cost and privacy is obvio…

Great work! I'm interested to know where the GPU servers are located. Are they in the US; do you run your own datacenter or rent servers on the hyperscalers?

FYI: some benchmark numbers at https://gist.github.com/kevinis/ca7fa432af076a5f3330c7e39daf...