Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

When ChatGPT turns informant

futureofbeinghuman.com

Post reply on HN
Print view View original

11–20 of 144 posts

Re: When ChatGPT turns informant

#11

Post by varispeed »

This is a bit of a nothingburger. If someone has access to your device it's game over anyway.

I am more annoyed that banking apps don't have an option to show different views based on pin number. For instance if you are in controlling relationship, partner might ask you to show your bank account to see what you spent money on. That suitcase and storage unit you rented to plan your escape? It's in plain sight and so the beating that follows.

And that is just one angle.

Phones themselves should allow for shadow user accounts, where you log in to completely isolated, encrypted and different environment based on pin number, so you always have plausible deniability.

Re: When ChatGPT turns informant

#12

Post by Insanity »

tonymillion wrote: post #6

Or… and bear with me on this… They could just read your text message and browser history

That takes more effort. If you have someone’s phone for 2 minutes while they are in the washroom or whatever, going through texts is harder than just asking chatGPT

Re: When ChatGPT turns informant

#13

Post by kid64 »

tonymillion wrote: post #6

Or… and bear with me on this… They could just read your text message and browser history

In the introductory section: "No trawling through hundreds of pages of chat logs, just a few well-crafted questions, and your deepest secrets are revealed."

Re: When ChatGPT turns informant

#14

Post by afavour »

emil-lp wrote: post #4

Most of the examples are "embarrassing" or annoying, and could perhaps ruin a relationship. But regardless of the memory setting in ChatGPT, I guess law enforcement can acquire all your chat logs from OpenAI. I guess what I'm saying is that while, yes, you could ask ChatGPT about this analysis, the true culprit is the actual data stored about you.

> I guess law enforcement can acquire all your chat logs from OpenAI

OpenAI could also just voluntarily give it to the government.

I'm trying to find ways to articulate these fears without sounding deep in hyperbole but it's undeniable that the current US government has authoritarian desires. When I look at all these services I'm forced to think "if push came to shove, would they stand up for my rights?", and I just don't have a lot of faith in the current tech giants.

Re: When ChatGPT turns informant

#15

Post by sfRattan »

Insanity wrote: post #10

At some point I got curious about how close ChatGPT would get to my Myers-Briggs profile based on my chats over the past year. It accurately got my type.. could be a coincidence of course, but I thought it was quite interesting. It also provided supporting evidence from the many types of different conversations we have had.

Likely coincidence. Myers-Briggs has no scientific validity and is the corporate equivalent of horoscopes in the newspaper. [1]

When someone asks for your Myers-Briggs type, give them a zodiac sign. When someone asks for your zodiac sign, give them a Myers-Briggs type. ;)

[1]: https://www.independent.co.uk/voices/myers-briggs-psychology...

Re: When ChatGPT turns informant

#16

Post by roywiggins »

tonymillion wrote: post #6

Or… and bear with me on this… They could just read your text message and browser history

it's just far easier to ask ChatGPT "hey have I ever mentioned cheating on my partner", with a fun extra risk of ChatGPT making something up that's worse than anything you actually wrote. So it 1) makes finding true positives a lot easier and 2) can invent false positives very easily also

Re: When ChatGPT turns informant

#17

Post by tptacek »

I'm not sure I see how this is meaningfully different than the threat posed by a search engine. It's a very real threat, and I've always done my best to search from a browser context that isn't logged in as a result. But it's not a new threat, or something distinctive to AI.

Re: When ChatGPT turns informant

#18

Post by caminanteblanco »

From my reading, this is completely unhelpful in determining how easy it would be to exfiltrate sensitive data from ChatGPT's memory. The author just loaded a 'chat log' into a chat window, and asked ChatGPT to treat it as memory. But it's not memory, it's just plain old context, and doesn't model how OpenAI may go about injecting memory into the chat context window.

Re: When ChatGPT turns informant

#19

Post by Spivak »

rietta wrote: post #9
SketchySeaBeast wrote: post #5

Earlier quoted context omitted.

Use "Will I be ok with this transcript between me and ChatGPT being read back verbatim in a court of law?" as a guide for what you send ChatGPT.

The practical short answer is yes, yes it will. It is not privileged communication. It is not considered private since you have left it on a third party server. It is discoverable via legal process to the third parties that retain the chat log. The same goes for communications on any social media or public forum, including discussions here on HN.

Which is so stupid, there's a probably a million examples of this exact pattern. It is crazy that courts have decided that people don't have a reasonable expectation of privacy for data that is otherwise kept secret with multiple locks, and guards at the door. Clearly people expect it to be kept private, it's more protected than their house.

If I ask Alice to store my diary for me and keep it secret it seems obvious to everyone except law enforcement that you should have to get a warrant and serve it to me before getting it from her.

Post reply on HN