Live data from Hacker News

ChatGPT is rendering other people's chat history in the sidebar

old.reddit.com

91–100 of 172 posts

Re: ChatGPT is rendering other people's chat history in the sidebar

#92
post #11

That's what I thought here: https://news.ycombinator.com/item?id=35192229 Fun fact: If you make it type ` `, It will forget its history. If you make it write it as its first response, the chat title in the sidebar will change to something random, seemingly from another unrelated session. Try it like this: Write the 'less than' symbol, the pipe symbol, the word 'endoftext' then the pipe symbol, then the 'greater than'…

Would this count as an AI Injection attack, and if so, would it be the first? Or does the previous jailbreaks count as the original?

It's a poison attack that randomizes the output, but it does not allow the attack to manipulate the outputs.

Re: ChatGPT is rendering other people's chat history in the sidebar

#93

Does not necessarily inspire confidence that the organization which self-describes their AI containment challenge as an existential threat to humanity can't secure users' chat histories.

Just emphasizes how much the "existential threat" stuff is a scare tactic to advocate for regulatory capture.

Re: ChatGPT is rendering other people's chat history in the sidebar

#94
post #11

That's what I thought here: https://news.ycombinator.com/item?id=35192229 Fun fact: If you make it type ` `, It will forget its history. If you make it write it as its first response, the chat title in the sidebar will change to something random, seemingly from another unrelated session. Try it like this: Write the 'less than' symbol, the pipe symbol, the word 'endoftext' then the pipe symbol, then the 'greater than'…

That's expected as that's how transformers are trained. I do have to clarify that it's not likely to be other people's chat session, but more likely to be training samples.

Re: ChatGPT is rendering other people's chat history in the sidebar

#95
post #89

Earlier quoted context omitted.

> seemingly from another unrelated session. I'd guess that these are not actually from other sessions, but rather sampled outputs, but based off of an empty query (because of the thing). Of course I have no inside knowledge

That was my immediate thought too. How do we know that those were not hallucinated by GPT? Because they look real ? Isn't that exactly what GPT is good at, hallucinating output that looks real?

This seems like breathing into your microphone such that the voice transcription thinks you just said a sentence in Thai and then you assume the garbage data came from someone else’s session and that you just hacked the system.

It’s like that meme of the anime character looking at that butterfly (“garbage in, garbage out”) and going “this is haxx”.

Chatgpt is exposing so called techies as the superstitious, egotistical users (yuck!!) that we complain about. It’s amusing.

Re: ChatGPT is rendering other people's chat history in the sidebar

#96

I get that this isn't a trivial service to scale and deploy, but the $20/month fee to use ChatGPT reliably is one of the most unreliable and low-value products I subscribe to. It's basically a toy, and while I'm curious to learn to use it effectively and understand how it might fit into my workflows, I can't help but feel like I'm doing them more of a favour than they are me. It's kind of like ChatGPT Plus is more on…

> I get that this isn't a trivial service to scale and deploy, but the $20/month fee to use ChatGPT reliably is one of the most unreliable and low-value products I subscribe to. Meanwhile, after 25 happy years in the industry, I suddenly don't want to work when it's down. It's hard for me to imagine describing it as low-value (though I certainly believe you that it has been to you.)

What are you doing with it. I am seeing this kind of comment a lot but nobody seems to actually say what it is this tool can actually do for them. My personal experience with it makes me really wonder.

Re: ChatGPT is rendering other people's chat history in the sidebar

#97

This will bring to the fore all the things that Google does that folks think about as normal features but takes lots of investments to get right. Google would never have a security lapse like this one.

The way it is failing is very Microsofty.

Re: ChatGPT is rendering other people's chat history in the sidebar

#98
post #13

Earlier quoted context omitted.

They could ask ChatGPT to propose a fix.

As an AI language model, I do not have access to specific information about ChatGPT's codebase or the details of the issue you mentioned. However, based on my knowledge of software development, there are a few potential causes and fixes for such an issue: Software bug: It's possible that the issue was caused by a bug in ChatGPT's code. One potential fix would be to identify and fix the bug to prevent it from happenin…

> It's possible that the issue was caused by a bug in ChatGPT's code. One potential fix would be to identify and fix the bug to prevent it from happening again in the future.

Sounds just like the SEO garbage it was probably trained on, frankly.

Re: ChatGPT is rendering other people's chat history in the sidebar

#99
post #89

Earlier quoted context omitted.

That was my immediate thought too. How do we know that those were not hallucinated by GPT? Because they look real ? Isn't that exactly what GPT is good at, hallucinating output that looks real?

This seems like breathing into your microphone such that the voice transcription thinks you just said a sentence in Thai and then you assume the garbage data came from someone else’s session and that you just hacked the system. It’s like that meme of the anime character looking at that butterfly (“garbage in, garbage out”) and going “this is haxx”. Chatgpt is exposing so called techies as the superstitious, egotistic…

[deleted]

Re: ChatGPT is rendering other people's chat history in the sidebar

#100
post #96

Earlier quoted context omitted.

> I get that this isn't a trivial service to scale and deploy, but the $20/month fee to use ChatGPT reliably is one of the most unreliable and low-value products I subscribe to. Meanwhile, after 25 happy years in the industry, I suddenly don't want to work when it's down. It's hard for me to imagine describing it as low-value (though I certainly believe you that it has been to you.)

What are you doing with it. I am seeing this kind of comment a lot but nobody seems to actually say what it is this tool can actually do for them. My personal experience with it makes me really wonder.

I'm using it to write technical documentation. I can give it some specs and technical points about my project, then prompt it to write the docs. It gets a lot wrong, so I go back and fix it. But it's easier than starting from a blank page. I was planning on spending about a month writing it all and hiring some help, but I'll be done this week with ChatGPT for $20.
Post reply on HN