A ChatGPT-like assistant but private for developers

This is a really interesting approach to AI privacy. I'm curious to see how the performance of the local models compares to cloud-based solutions, especially when it comes to handling complex queries. Quick user feedback: I tried to generate violent images (just for the sake of testing), but I felt it was still being censored by the AI model.

Privacy is the top one concern for Series B+ companies from my experience. On the other hand, if the LLMs need to run on a developer laptop you should choose small open source models which usually don't perform well. My experience with llama 8b was negative.

Cool!

With Anon being marketed as a private, no-login AI assistant, I'm curious about the trade-offs involved. Does this privacy-first approach impact the assistant's capabilities compared to other more data-driven AI tools? Has anyone tested it out in real-world scenarios?

Traditional models: collect data and store it on central servers. Anon AI models: Conversational data still go to an LLM, currently hosted by us. However, we've implemented several measures to ensure user data security: - Our AI model is stateless, meaning it doesn't store any info about previous conversations. - We use ephemeral processing, where user input is processed in real-time and only retained for the duration of the request. - The AI model processes user input in memory only, without writing any data to disk. - Any temporarily stored data is automatically purged at the end of the process. As we scale with model providers, we'll thoroughly vet them to ensure they meet our security standards. Thanks for pointing this out, and I hope this helps address your concerns!