Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ShareGPT: Share your ChatGPT conversations with one click

sharegpt.com

Post reply on HN
Print view View original

31–40 of 42 posts

Re: ShareGPT: Share your ChatGPT conversations with one click

#31

Post by sebzim4500 »

londons_explore wrote: post #10
albert_e wrote: post #4

How much of GPT generated text is going back right onto training new LLMs. This has to eventually overwhelm organic human generated content doesn't it? What's the way out of this

While OpenAI keeps logs of every response ever returned, they can just filter that text out of any future training data. Those logs aren't as large or unwieldy as they appear - the cost of storing a thousand words of text is tiny compared to the compute cost to generate it.

True, but presumably OpenAI won't be running the only publically available LLMs forever.

Re: ShareGPT: Share your ChatGPT conversations with one click

#33

Post by anoncow »

amelius wrote: post #23
bil7 wrote: post #5

to quote Tom Scott: "Telling someone about your fascinating AI conversation is like telling someone about your dreams. They don’t care, it just sounds like you’re hallucinating nonsense."

Why? We might learn about the failure modes of AI.

Can we arrive at some absolute rules about AI using the interactions?

Re: ShareGPT: Share your ChatGPT conversations with one click

#34

Post by simonh »

sebzim4500 wrote: post #27
simonh wrote: post #17

Earlier quoted context omitted.

> Why is inserting the best outputs from GPT-4 into the training set for GPT-5 expected to make things worse? Firstly what makes you think only the best output from 4 will go into future training sets? It’s just as likely to be the most bizarre or ludicrous, or dangerous that gets shared and discussed. But also, how will v5 get to be better than v4 if it’s trained significantly on v4 output? It would just end up bein…

>Firstly what makes you think only the best output from 4 will go into future training sets? It’s just as likely to be the most bizarre or ludicrous That's true now, because LLMs are new so the failure cases are still interesting. If we are talking about a hypothetical world in which LLM outputs are a significant portion of the internet, then most of it would be from reddit comments/tweets/HN posts/buzzfeed articles/…

I'm still not convinced that's a reliable indicator of quality. It's potentially a measure of popularity or entertainment value, or maybe pandering to preconceptions but that's not at all the same thing.

Ask yourself, what are your from-scratch metrics for quality that you would like to select for. Then consider what are the likely or possible criteria people actually have for upvoting stuff on reddit. I'll think you'll find there is probably very little correlation between those. This is called the alignment problem and it's very hard to get right.

Re: ShareGPT: Share your ChatGPT conversations with one click

#35

Post by jacobkranz »

exodust wrote: post #14
jacobkranz wrote: post #11

I’m actually really excited for this because I use chatGPT all the time for work and being able to share the output of code to another engineer will make things a lot easier. I agree with others about it not being useful for mundane things but there are times chatGPT will generate a lot of code in different blocks & it’s a pain to share.

But why are you the middleman between the other engineer and chatGPT output? If any role is doomed to obsolescence it's the guy forwarding chatGPT output to his coworkers!

Two quick examples:

1. In our codebase, we leave links to the stackoverflows as documentation if it's something that someone else may question. Exact same concept just with ChatGPT.

2. I'm working with the Salesforce API which has been absolutely tedious to use but chatGPT, while not great at everything, has been giving awesome results back that otherwise would take me hours to hunt down. Sometimes responses get a lot of information back with multiple code blocks that I'm then unable to copy paste over & I'd rather send the conversation than spend 15 minutes typing back & forth explaining myself to a co-worker.

I completely understand you may not have a use for this but I think there could be awesome use-cases for it nonetheless for other engineers.

Re: ShareGPT: Share your ChatGPT conversations with one click

#36

Post by ainiriand »

I use ChatGPT all the time for my Unreal Engine C++ development. Whenever I find an interesting solution provided by the AI it is like finding a rare treasure. If it is useful enough I tell the AI to outline a blog post about it and I save it as a draft to expand/correct later.

Yes, I love AI, but I am not sure how useful would it be to see/read other people prompts.

Re: ShareGPT: Share your ChatGPT conversations with one click

#37

Post by Y_Y »

sebzim4500 wrote: post #28
marginalia_nu wrote: post #12

Earlier quoted context omitted.

In chess there is a very clear victory state, and a scoring function can be implicitly defined from a large number of games of various skill levels. You really don't throw two sentences into the thunder dome to decide which one "wins". Means it's much more susceptible to being poisoned.

>You really don't throw two sentences into the thunder dome to decide which one "wins". That's almost literally what RLHF is though, and that is the last step of training GPT-n. Then when GPT-{n+1} is being trained, it will include some results from GPT-n, and therefore will benefit from that finetuning, even before it goes through its own round of RLHF. Also, on average good outputs of GPT-n are more likely to be in…

That not what RLHF is. In the thunderdome, as in chess, you don't need human judges or an oracle to know who's won. That makes a significant difference to the training procedure.

Re: ShareGPT: Share your ChatGPT conversations with one click

#38

Post by cjglo »

ainiriand wrote: post #36

I use ChatGPT all the time for my Unreal Engine C++ development. Whenever I find an interesting solution provided by the AI it is like finding a rare treasure. If it is useful enough I tell the AI to outline a blog post about it and I save it as a draft to expand/correct later. Yes, I love AI, but I am not sure how useful would it be to see/read other people prompts.

Do you find ChatGPT is good with C++?

In my experience, it does very well, but then suddenly is very confident of something that is wrong.

Maybe its like this for all languages, but it seems way more accurate with python.

Re: ShareGPT: Share your ChatGPT conversations with one click

#39

Post by Jensson »

siva7 wrote: post #16
exodust wrote: post #14

Earlier quoted context omitted.

But why are you the middleman between the other engineer and chatGPT output? If any role is doomed to obsolescence it's the guy forwarding chatGPT output to his coworkers!

Because he has people skills.

They call it prompt engineer nowadays. Some are experts at engineering prompts to human resources, other engineer prompts to artificial resources.

Re: ShareGPT: Share your ChatGPT conversations with one click

#40

Post by simonh »

anoncow wrote: post #33
amelius wrote: post #23

Earlier quoted context omitted.

Why? We might learn about the failure modes of AI.

Can we arrive at some absolute rules about AI using the interactions?

At best you would get rules about this particular implementation and training approach. I don't see why we would expect those to apply to AI generally.
Post reply on HN