Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

A ChatGPT-like assistant but private for developers

autonomous.ai

Post reply on HN
Print view View original

1–10 of 34 posts

Re: A ChatGPT-like assistant but private for developers

#3

Post by duyhtq »

I tried hosting several small-size LLM models. It requires lots of work, but it’s worth it to customize my own sick chatbot. However, hosting a large model with billions of params is super painful and expensive.

Using a public service like chatGPT or Replicate is easier and more affordable but I am really concerned about data privacy. We all know some are collecting and using user data for training or other purposes. What makes you different from others?

Re: A ChatGPT-like assistant but private for developers

#4

Post by brody_slade_ai »

duyhtq wrote: post #3

I tried hosting several small-size LLM models. It requires lots of work, but it’s worth it to customize my own sick chatbot. However, hosting a large model with billions of params is super painful and expensive. Using a public service like chatGPT or Replicate is easier and more affordable but I am really concerned about data privacy. We all know some are collecting and using user data for training or other purposes.…

Agree. That’s why I want to build a truly private AI, where users are confident to use without worry about their privacy. At first, we hosted stateless AI models using ephemeral processing to handle real time convos. We designed and implemented a protocol to ensure E2EE via TLS/SSL, GDPR/CCPA compliant with conversations stored locally on-device. We also provide an anonymous mechanism, no login required. Currently, we hosted open source flagship models of meta, Llama 3.1 405B, Llama 3.2 Vision and FLUX.1[dev] The product has just launched and is free to use with unlimited prompts. Paid plans are for AI agents. We still have a long way to go and would love to hear your feedback.

Re: A ChatGPT-like assistant but private for developers

#7

Post by brody_slade_ai »

ngbng wrote: post #5

Need to understand, despite the privacy, is there any other difference compared to other AI assistants?

Besides our focus on privacy, what sets us apart is we'ew using some of the latest AI models out there. Our tech stack includes

- Llama 3.1 405B by Meta (outperforming GPT4 by 13%) - Llama 3.2 Vision by Meta (we're one of the first to use it!) - FLUX.1 [dev] by Black Forest Labs

Re: A ChatGPT-like assistant but private for developers

#8

Post by brody_slade_ai »

rock115 wrote: post #6

Can users delete their conversation history, and if so, how is it handled? Are conversations deleted permanently, or are they retained for a certain period of time?

Yeah you can delete your conversation history whenever you want. Since we store data locally only, you have full control over it. Delete it, and it's gone for good. We don't retain any copies on our servers.

Re: A ChatGPT-like assistant but private for developers

#9

Post by rock115 »

brody_slade_ai wrote: post #8
rock115 wrote: post #6

Can users delete their conversation history, and if so, how is it handled? Are conversations deleted permanently, or are they retained for a certain period of time?

Yeah you can delete your conversation history whenever you want. Since we store data locally only, you have full control over it. Delete it, and it's gone for good. We don't retain any copies on our servers.

That's really cool! How do you ensure the AI model is not storing or retaining user data?
Post reply on HN