Live data from Hacker News

OpenAI says it's scanning users' conversations and reporting content to police

futurism.com

211–220 of 248 posts

Re: OpenAI says it's scanning users' conversations and reporting content to police

#211
Great, replace search with a new "tool" that is fully capable of autonomously analyzing user behavior and hand that data over on a silver platter to law enforcement bypassing all the legal red tape.

AI truly is a Faustian Bargain. A powerful daemon in your pocket that can do wonderous things, but is still a daemon.

Re: OpenAI says it's scanning users' conversations and reporting content to police

#212

At what point would an llm be considered to be practicing medicine without a license legally; or would that only apply to persons?

It's probably the parent corporation who would be liable for practicing medicine without a license and not the LLM (which is merely a software created by the said corporation).

Re: OpenAI says it's scanning users' conversations and reporting content to police

#213
post #10
post #7

This is exactly why a lot of people are running local LLMs or moving toward privacy-first platforms we recently shipped secure mode on https://www.agentsea.com . With Secure Mode, all chats run either on open-source models or models hosted on our own servers - so you can chat with AI without worrrying about privacy.

There is a very strong use case for less-powerful but local LLMs, and there's going to be a big expansion in that area in the next couple years. So big, I'll bet that all the major AI players will do everything they can to cripple them.

Unfortunately I think you're overestimating how many people care enough about privacy to go through the effort of running LLMs locally and likely buying a GPU

Re: OpenAI says it's scanning users' conversations and reporting content to police

#214

At what point would an llm be considered to be practicing medicine without a license legally; or would that only apply to persons?

It's probably the parent corporation who would be liable for practicing medicine without a license and not the LLM (which is merely a software created by the said corporation).

Right, I agree, but my question stands - isn’t that what they are doing?

Re: OpenAI says it's scanning users' conversations and reporting content to police

#215

Earlier quoted context omitted.

Or maybe I just want to be able to talk to an LLM without worrying about if its going to report me to the authorities.

that’s a good point, privacy is important. To play devils advocate for a second, what if someone that’s mentally ill uses a local LLM for therapy and doesn’t get the help they need? Even if it’s against their will? And they commit suicide or kill someone because the LLM said it’s the right thing to do… Is being dead better, or is having complete privacy better? Or does it depend? I use local LLMs too, but it’s dising…

I don't want to deal with prompt injection attacks leading to being swatted. That's where all this reporting to the authorities is leading and it's not looking fun.

> Is being dead better, or is having complete privacy better? Or does it depend?

I know you're being provocative, but this feels like a false dichotomy. Mental health professionals are pro-privacy AND have mandatory reporting laws based on their best judgement. Do we trust LLMs to report a suicidal person that has been driven there by the LLM itself?

LLMs can't truly be controlled and can't be designed to not encourage mentally ill people to kill themselves.

> Mentally ill people trying to use an LLM for therapy

Yes indeed this is one of the core problems. I have experimented with this myself and the results were highly discouraging. Others that don't have the same level of discernment for LLM usage may mistake the confidence of the output for a well-trained therapist.

Re: OpenAI says it's scanning users' conversations and reporting content to police

#216

Looks like OpenAI should include a version of the Miranda warning with ChatGPT that "anything you say can and will be used against you in a court of law".

Every online service is compelled by law to answer subpoenas. You're supposed to assume the collaborate with the state.

OpenAI isn't talking about responding to subpoenas; it's volunteering information to the gov. That's a very different thing.

Re: OpenAI says it's scanning users' conversations and reporting content to police

#217
The company provides a probabalistic predictive text "chat". The responsibility ends there. I pay for electricity but Edison Electric doesn't ring the police when I get close to the power outlet with a metal fork.

This opens to door to a ton of creepy things.

Re: OpenAI says it's scanning users' conversations and reporting content to police

#218

Earlier quoted context omitted.

yeh by that justification our technological advancement should have stopped at sharpened sticks. "As a species we aren't ready to have sharp sticks"

Maybe it should have? It's probably too late now - Pandora's box has been opened - but just in the US, about one school shooting or mass shooting every two days proves that at least one member of the species isn't uniformly ready to have firearms. Assuming for a moment that sanctioned warfare is justifiable, in peacetime we have at least managed to build a political and military apparatus that has generally kept nucl…

Even ignoring the mass shootings, the fact that firearms are used at all against fellow human beings indicates that we aren't ready for it.

Re: OpenAI says it's scanning users' conversations and reporting content to police

#219
post #23

Earlier quoted context omitted.

#shutupandtakemymoney (if you knew how most processed food were made, you wouldn't touch anything other than fresh vegetables).

All food (other than raw produce) is processed. Cooking meat over a fire makes it processed food. You'll have to be more specific.

you knew exactly what I meant, so no, I won't.

Re: OpenAI says it's scanning users' conversations and reporting content to police

#220

Earlier quoted context omitted.

This is beyond naive. who would bother to develop it in a lab and publish pro bono if it can never be commercial? Making money is why the most capitalist countries developed this tech. like most other tech and even if it is only published, do you think we wouldn't run chatbots ourselves at home with same results? remember how Google engineer went off the rails thinking it is conscious while working on this stuff, do…

you're making this comment on the world wide web, which was invented and given away for free - likely against a linux machine, an open and free project

you are making this comment on computer hardware which is a prerequisite for www and which was invented and made because it's profitable
Post reply on HN