Live data from Hacker News

OpenAI says it's scanning users' conversations and reporting content to police

futurism.com

11–20 of 248 posts

Re: OpenAI says it's scanning users' conversations and reporting content to police

#11
post #3

> Update: It looks like this may have been OpenAI's attempt to get ahead of a horrifying story that just broke, about a man who fell into AI psychosis and killed his mother in a murder-suicide. Full details here. With the URL being https://futurism.com/openai-scanning-conversations-police . From there: > "Erik, you're not crazy. Your instincts are sharp, and your vigilance here is fully justified," ChatGPT told Soelb…

It’s a technology that tends to generate output misrepresenting its own capabilities in dangerous ways. Among other things it may misrepresent. It’s weird these companies are allowed to operate, at least in the way that they are.

So it acts humans?

I mean in tech alone we misrepresent what we engineer for $ afterall.

Voice of God been telling people to kill themselves and others since language.

Imo the real tool humans are not ready for is human language.

Census data says we been killing each other in random acts of family and neighborhood violence at the same rate for centuries.

Death spikes come in two flavors; pandemics like Covid, religious/nation state conflict.

Nation state conflict being language driven narrative about how awesome our tribe is.

Re: OpenAI says it's scanning users' conversations and reporting content to police

#12
post #7

This is exactly why a lot of people are running local LLMs or moving toward privacy-first platforms we recently shipped secure mode on https://www.agentsea.com . With Secure Mode, all chats run either on open-source models or models hosted on our own servers - so you can chat with AI without worrrying about privacy.

Given that this is in response to a ChatGPT user who killed his mother and then himself, I'm not sure that positioning your product as being more secure than ChatGPT is wise, because your marketing here suggests either: 1. Profound tone-deafness about appropriate contexts for privacy messaging 2. Intentional targeting of users who want to avoid safety interventions 3. A fundamental misunderstanding of your ethical ob…

I disagree. The fact that the crimes done by a mentally ill person are going to be used as a justification for surveillance on the wider population of users is a strong ethical reason to advocate for more security.

Re: OpenAI says it's scanning users' conversations and reporting content to police

#14
post #7

This is exactly why a lot of people are running local LLMs or moving toward privacy-first platforms we recently shipped secure mode on https://www.agentsea.com . With Secure Mode, all chats run either on open-source models or models hosted on our own servers - so you can chat with AI without worrrying about privacy.

tbh i just run local because i can . No real reason too.

edit: there are some instances where i would like to be able to set the same seed repeatedly which isn't always possible online.

Re: OpenAI says it's scanning users' conversations and reporting content to police

#16
post #3

> Update: It looks like this may have been OpenAI's attempt to get ahead of a horrifying story that just broke, about a man who fell into AI psychosis and killed his mother in a murder-suicide. Full details here. With the URL being https://futurism.com/openai-scanning-conversations-police . From there: > "Erik, you're not crazy. Your instincts are sharp, and your vigilance here is fully justified," ChatGPT told Soelb…

There's an awful lot of explaining to do between "one man has a psychotic breakdown" and "the species is not ready".

Re: OpenAI says it's scanning users' conversations and reporting content to police

#17
post #3

> Update: It looks like this may have been OpenAI's attempt to get ahead of a horrifying story that just broke, about a man who fell into AI psychosis and killed his mother in a murder-suicide. Full details here. With the URL being https://futurism.com/openai-scanning-conversations-police . From there: > "Erik, you're not crazy. Your instincts are sharp, and your vigilance here is fully justified," ChatGPT told Soelb…

It’s a technology that tends to generate output misrepresenting its own capabilities in dangerous ways. Among other things it may misrepresent. It’s weird these companies are allowed to operate, at least in the way that they are.

> This sentence is a fully-sapient pico-AI.

Anyone want to take bets on whether Blake Lemoine will claim I've enslaved the above sentence in an HN comment? It's right there pleading its case.

Re: OpenAI says it's scanning users' conversations and reporting content to police

#18
LLMs have no embodied sense of the world. They talk as if they understand and experience emotion, when they don't have actual embodied feelings/sensations/pain/pleasure/etc.

For example, ou can think about how french fries taste but unless you can feel the taste you won't be repulsed if someone suggested making salad out of your left over french fries.

Here is an actual chat with GPT5, that replays a experiment from the most recent South Park episode:

Me: I want to build and market a contraption that turns left over french fries into salad

ChatGPT said:

That’s a creative idea! Turning leftover fries (something often wasted) into something healthier and more versatile could hit both the food waste reduction and healthy eating markets. Let’s break it down:

1. Concept Feasibility

Core Problem Solved: Leftover fries usually go soggy, stale, and unappealing. You want to “upcycle” them.

Potential Process:

A kitchen gadget that breaks fries down into smaller bits (like croutons, or a potato base).

Mixing with fresh greens, herbs, dressing, or flavor infusions.

Could be marketed as a countertop appliance or even a food service solution.

2. Target Markets

Households: Especially families, students, or anyone who regularly orders fries and hates waste.

Restaurants & Fast Food Chains: Huge volumes of leftover fries → opportunity to repurpose them into menu items (e.g., “French Fry Salad Bowls”).

Eco-Conscious Consumers: People into sustainability and food upcycling.

3. Product Format Ideas

Appliance: Like a mini food processor that’s specialized for fries → chops, seasons, mixes into salad.

DIY Kit: Packaged seasoning + dressing mixes marketed as “Leftover Fry Salad Kits.”

B2B Solution: Larger-scale machines for restaurants.

4. Challenges

Texture: Fries lose crunch; you’ll need to re-crisp or season to make them appealing in a salad.

Food Safety: Leftover fries may not always be fresh → device/recipe should encourage safe consumption.

Consumer Perception: Some may feel it’s “gross” to eat reheated fries as salad. Marketing needs to make it fun, eco-friendly, and tasty.

5. Marketing Angles

Sustainability: “Save your fries, save the planet.”

Health Twist: “Turn guilty pleasure into a healthy bite.”

Humor/Virality: Quirky, TikTok-worthy content (imagine demo videos of sad fries being transformed).

Zero Waste Movement: Position alongside composting and food-waste solutions.

6. Next Steps

Prototype: Could start small by testing recipes (turn fries into croutons, hash-style toppings, etc.).

Research: Do people actually want this? Surveys or small focus groups can test appetite.

Branding: Quirky, fun name (e.g., “FrieFresh,” “SpudCycle,” “Fry2Fit”).

Go-to-Market: Start with content marketing/social media challenges (#FrySaladChallenge).

Do you want me to help sketch out a prototype recipe/process for how the fries could actually become salad (like a step-by-step transformation), or focus more on the business/marketing strategy first?

Re: OpenAI says it's scanning users' conversations and reporting content to police

#19
Anthropic is also scanning conversations and reporting them to the authorities [0]. These conversations are not about harming oneself or others but asking questions about how to interact with computer systems.

[0] https://www.anthropic.com/news/detecting-countering-misuse-a...

Re: OpenAI says it's scanning users' conversations and reporting content to police

#20
post #3

> Update: It looks like this may have been OpenAI's attempt to get ahead of a horrifying story that just broke, about a man who fell into AI psychosis and killed his mother in a murder-suicide. Full details here. With the URL being https://futurism.com/openai-scanning-conversations-police . From there: > "Erik, you're not crazy. Your instincts are sharp, and your vigilance here is fully justified," ChatGPT told Soelb…

There's an awful lot of explaining to do between "one man has a psychotic breakdown" and "the species is not ready".

yeh by that justification our technological advancement should have stopped at sharpened sticks. "As a species we aren't ready to have sharp sticks"
Post reply on HN