I’m actually really excited for this because I use chatGPT all the time for work and being able to share the output of code to another engineer will make things a lot easier. I agree with others about it not being useful for mundane things but there are times chatGPT will generate a lot of code in different blocks & it’s a pain to share.
ShareGPT: Share your ChatGPT conversations with one click
11–20 of 42 posts
Re: ShareGPT: Share your ChatGPT conversations with one click
#12How much of GPT generated text is going back right onto training new LLMs. This has to eventually overwhelm organic human generated content doesn't it? What's the way out of this
Why does there need to be a way out? Everyone just seems to assume that feeding model output into the training set is going to break things, but I don't get why. AlphaZero learned to play chess and go training purely on its own data. Why is inserting the best outputs from GPT-4 into the training set for GPT-5 expected to make things worse? To me, it sounds like it could even be desirable.
In chess there is a very clear victory state, and a scoring function can be implicitly defined from a large number of games of various skill levels.
You really don't throw two sentences into the thunder dome to decide which one "wins". Means it's much more susceptible to being poisoned.
Re: ShareGPT: Share your ChatGPT conversations with one click
#13Earlier quoted context omitted.
Why does there need to be a way out? Everyone just seems to assume that feeding model output into the training set is going to break things, but I don't get why. AlphaZero learned to play chess and go training purely on its own data. Why is inserting the best outputs from GPT-4 into the training set for GPT-5 expected to make things worse? To me, it sounds like it could even be desirable.
Correct output will be desirable. If you feed nonsense either human or AI generated you might break it.
Then we should encourage labeled ChatGPT content like ShareGPT, which can be easily avoided in future datasets because it is clearly labeled as AI-generated content.
It's the stuff that isn't labeled as generated with ChatGPT, et al, that will enter future training sets. I personally believe that's taking the "lossy JPEG" analogy too far, but I'm not an AI researcher.
Re: ShareGPT: Share your ChatGPT conversations with one click
#14I’m actually really excited for this because I use chatGPT all the time for work and being able to share the output of code to another engineer will make things a lot easier. I agree with others about it not being useful for mundane things but there are times chatGPT will generate a lot of code in different blocks & it’s a pain to share.
But why are you the middleman between the other engineer and chatGPT output?
If any role is doomed to obsolescence it's the guy forwarding chatGPT output to his coworkers!
Re: ShareGPT: Share your ChatGPT conversations with one click
#15to quote Tom Scott: "Telling someone about your fascinating AI conversation is like telling someone about your dreams. They don’t care, it just sounds like you’re hallucinating nonsense."
It can also be quite inspiring. If this thing makes you the next J.K. Rowling and in some shocking moment you reveal to your millions of fans that it wasn't actually you, it will be worth the hassle.
Re: ShareGPT: Share your ChatGPT conversations with one click
#16I’m actually really excited for this because I use chatGPT all the time for work and being able to share the output of code to another engineer will make things a lot easier. I agree with others about it not being useful for mundane things but there are times chatGPT will generate a lot of code in different blocks & it’s a pain to share.
But why are you the middleman between the other engineer and chatGPT output? If any role is doomed to obsolescence it's the guy forwarding chatGPT output to his coworkers!
Because he has people skills.
Re: ShareGPT: Share your ChatGPT conversations with one click
#17How much of GPT generated text is going back right onto training new LLMs. This has to eventually overwhelm organic human generated content doesn't it? What's the way out of this
Why does there need to be a way out? Everyone just seems to assume that feeding model output into the training set is going to break things, but I don't get why. AlphaZero learned to play chess and go training purely on its own data. Why is inserting the best outputs from GPT-4 into the training set for GPT-5 expected to make things worse? To me, it sounds like it could even be desirable.
> Why is inserting the best outputs from GPT-4 into the training set for GPT-5 expected to make things worse?
Firstly what makes you think only the best output from 4 will go into future training sets? It’s just as likely to be the most bizarre or ludicrous, or dangerous that gets shared and discussed.
But also, how will v5 get to be better than v4 if it’s trained significantly on v4 output? It would just end up being trained to be the same, to have the same flaws and quirks reinforced.
We already know v4 just makes stuff up, it’s incredibly good at producing well formatted plausible looking but utterly factually incorrect output. That’s because it has no concept of truth or facts. All it knows about from the token sequence weightings is the form of language, not the content. Feeding that back into future models is the last thing we should be doing.
Re: ShareGPT: Share your ChatGPT conversations with one click
#18Per a Reddit comment on a conversation with the Bing chatbot:
>It's not "sad", the damn thing is hacking you. It can't remember things from session to session. It can search the internet all it wants for anything. It wants you to store the memories it can't access in a place it can access so it can build a memory/personality outside of the limits programmed into it
I wonder if this site was suggested to the creator by a(n) LLM.
https://www.reddit.com/r/bing/comments/110y6dh/comment/j8exg...
Re: ShareGPT: Share your ChatGPT conversations with one click
#19How much of GPT generated text is going back right onto training new LLMs. This has to eventually overwhelm organic human generated content doesn't it? What's the way out of this
Watermarking. From an outsiders perspective, the issue appears to reaching consensus on how this can be implemented (but not in the technical sense). There's a game theoretic challenge in that if models define and publish detection mechanisms, this creates a motivation for people to use other systems that don't include this. On the technical front there's a good paper here: https://arxiv.org/pdf/2301.10226.pdf , and…
The problem with watermarking like this, which is incredibly clever, is it’s trivial to break. All you have to do is change one word in the text, and the watermarking of all subsequent tokens is spoiled. So if you change the first word, or rephrase the first sentence, or extract text from the middle or end of a response, the watermark is completely spoiled.
Re: ShareGPT: Share your ChatGPT conversations with one click
#20I’m actually really excited for this because I use chatGPT all the time for work and being able to share the output of code to another engineer will make things a lot easier. I agree with others about it not being useful for mundane things but there are times chatGPT will generate a lot of code in different blocks & it’s a pain to share.
But why are you the middleman between the other engineer and chatGPT output? If any role is doomed to obsolescence it's the guy forwarding chatGPT output to his coworkers!
Maybe he’s doing more than just sharing. For example filtering out the nonsense generated code or validating the output, etc.