Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: IngestAI – NoCode ChatGPT-bot creator from your knowledge base in Slack

ingestai.io

Post reply on HN
Print view View original

111–117 of 117 posts

Re: Show HN: IngestAI – NoCode ChatGPT-bot creator from your knowledge base in Slack

#111

Post by nextaccountic »

wokwokwok wrote: post #11

Privacy policy: > We will not use or share your information with anyone except as described in this Privacy Policy. ... > We want to inform our Service users that these third parties have access to your Personal Information. The reason is to perform the tasks assigned to them on our behalf. However, they are obligated not to disclose or use the information for any other purpose. Arreeee they? So let me get this strai…

By using your data as training data, OpenAI might disclose your stuff to the world at large

Re: Show HN: IngestAI – NoCode ChatGPT-bot creator from your knowledge base in Slack

#112

Post by nextaccountic »

LeanderK wrote: post #58
vidarh wrote: post #52

Earlier quoted context omitted.

While the model clearly can't retain all data, ChatGPT can regurgitate a lot of stuff verbatim. Prompt: > Recite the first two paragraphs of Neuromancer. Response: > Certainly! Here are the first two paragraphs of "Neuromancer" by William Gibson: > "The sky above the port was the color of television, tuned to a dead channel. > 'It's not like I'm using,' Case heard someone say, as he shouldered his way through the cro…

I bet that getting the right prompts won't be easy so it will probably fly under the radar and not immediately be detected. You can't search these weights with command-f. Fun times ahead...

Prompt engineering is only getting better. Also,

> You can't search these weights with command-f

Sometimes you can, https://clementneo.com/posts/2023/02/11/we-found-an-neuron

Re: Show HN: IngestAI – NoCode ChatGPT-bot creator from your knowledge base in Slack

#113

Post by nextaccountic »

Vasyl_R wrote: post #98
stevofolife wrote: post #97

Earlier quoted context omitted.

Most startups are clueless and ignorant about data governance.

would you be able to advise a good startup or service that provides good governance of Data Privacy management for startups? We would like to learn more and get this point as good as possible.. But you're right in some degree- we're builders, and we need help of professionals with data governance.

Ok so, you replied everyone on this sub-thread except the top-level comment. Why is that?

Your first task to improve your privacy policy is to review whether you really, absolutely, for reals, can require OpenAI to follow this: "they are obligated not to disclose or use the information for any other purpose."

Because, it looks like you can't, and OpenAI will absolutely use your customers' data for their own purposes, so you probably should remove this line from your privacy policy at minimum.

Re: Show HN: IngestAI – NoCode ChatGPT-bot creator from your knowledge base in Slack

#114

Post by bluejay2387 »

Vasyl_R wrote: post #105
bluejay2387 wrote: post #104

Earlier quoted context omitted.

This is a well known problem with this technology (although I haven't seen an official term for it, so we have been calling them "recovery attacks'). It's apparently the reason companies like Amazon have banned internal use of services like ChatGPT. I should add while it has been proven to occur the likelihood of something like this is very low. It's going to be a rare occurrence.

thanks for sharing. Do you think if all would be on the client's local server or cloud there would be still some, even rare, occurrence of that?

The problem could still occur but you would have to be capturing all the queries to your internal LLM systems and then using that data for training. You have complete control of the model so you could just choose not to do that and I would think data leaks of this nature would be less of a concern for an internal environment anyway. You would know that only authorized individuals would have access to the data. I suppose there could still be a very small chance of leaking data to unauthorized employees, but if a rogue employee wants to access data they should not have access to fishing an LLM would probably be the least productive way to do that. Your access logs for the LLM system would clearly display the attempts.

Some commercial services are starting to offer "Enterprise" licenses that prohibit the collection and use for training of your data and that would address the concern as well.

Re: Show HN: IngestAI – NoCode ChatGPT-bot creator from your knowledge base in Slack

#115

Post by erur »

Vasyl_R wrote: post #24
erur wrote: post #21

First of all - this sounds like a super high potential concept. The big hurdle I'd see that would keep companies from tampering around with the current version is that there's no info on data protection & security. You won't get companies to share any internal info with a tool like that until that's out of the way - and even then it might require a lot of trust-building. Getting the certifications will be quite a cho…

Thank you so much for your comment and support! This is amazing how we're received here! Yes, we understand that to get enterprise companies we have to improve our Privacy Policy. Do you think adding possibility for our clients to store your data in your AWS S3 Cloud would be solution?

For what I'd call "stupid" compliance (GDPR,...), allowing for regional storage of data at rest is definitely important.

For any internal data where protecting it is a core interest of the company you'll also either need to prove your whole handling is trustworthy or you'll need to design a process that can do all the steps (preprocessing/vectorization/...) on customer controlled hardware.

If your solution can run in a customer owned environment without any external dependencies, that could save you a lot of auditing/certification.

Post reply on HN