Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

meta.stackoverflow.com

Post reply on HN
Print view View original

41–50 of 143 posts

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#41

Post by fragmede »

msla wrote: post #29
FooBarWidget wrote: post #24

It wouldn't surprise me at all if ChatGPT was trained on data originating from Stack Overflow. Not familiar with deep learning algorithms but I can't imagine that it would be a good idea to have an unintended training data loop.

An intended double-loop might be interesting: Train one GPT on the output of another.

OpenAI isn't giving out this service from the goodness of their hearts just for the fun of it. I bet they've gotten it to a place where they can feed its output back into itself for self improvement.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#42

Post by anon291 »

Well I asked chat gpt about a small Haskell library I maintain, and it correctly gave answers with code samples.

I input several emails I've received in private and it correctly answered those. This is not a huge library ecosystem or even a large language .

It then translated several Haskell code samples I have into c++.

I'm not sure if I'm in awe or just in shock to be honest.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#43

Post by NetOpWibby »

lovecg wrote: post #35

I think the ban on ChatGPT answers on Stack Overflow is a mistake. Sure, some of the answers might not be correct, but that's true for any tool. And the fact that ChatGPT answers are easy to produce means that more people can contribute, which can only be a good thing for the community. Plus, it's not like the moderators have to accept every answer - they can still weed out the bad ones. Let's not punish everyone bec…

Compelling argument

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#44

Post by mormegil »

liuliu wrote: post #23
vxNsr wrote: post #11

Do they have a plan for identifying chatGPT posts aside from “looks like it”?

Since it is a centralized service provided by OpenAI, they should really provide services (paid or not) that given a text, check if it is generated by ChatGPT recently.

While a great idea, how could this work so that it would be tolerant to publishing just excerpts of the full output or to ignore trivial edits (either way, it could be fooled easily, I guess)?

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#45

Post by fileeditview »

mjr00 wrote: post #25
colesantiago wrote: post #3

StackOverflow and Google are finished. This is expected and it may not look like it now, but banning an advancement in technology (even temporary) is usually the first step to irrelevance of those pushing back. In a few years from now when ChatGPT and perhaps the much awaited GPT-4 are released, get better, (or even an implementation is open sourced) it will further plummet the usage for SO and Google. The genie is o…

> StackOverflow and Google are finished. This is expected and it may not look like it now, but banning an advancement in technology (even temporary) is usually the first step to irrelevance of those pushing back. Depends on the reason for banning a technology. In this case it isn't because SO's business model is threatened, really; right now it's largely because the ChatGPT answers are usually wrong, and getting spam…

Exactly. If ChatGPT was so great for this purpose they could just plug it into SO and suddenly they wouldn't need any real users anymore farming for points.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#46

Post by gremlinsinc »

autotune wrote: post #31
arthurofbabylon wrote: post #27

What is the mechanism by which a text is determined to originate from ChatGPT? This will be crucial for preventing unfavorable training loops among a myriad of other human-led control efforts.

To determine if a post on StackOverflow is generated by ChatGPT, you could look for certain characteristics that are typical of posts generated by the model. For example, ChatGPT posts may contain repetitive or nonsensical phrases, lack coherence or context, or have a distinctive "machine-like" writing style. Additionally, you can check the user profile of the poster to see if it indicates that the user is a language…

This has become a meme, at this point.

- my opinion, not generated by ChatGPT.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#48

Post by insanitybit »

9wzYQbTYsAIc wrote: post #38
insanitybit wrote: post #30

Earlier quoted context omitted.

I'm asking what makes it worse.

From the post: “The volume of these answers (thousands) and the fact that the answers often require a detailed read by someone with at least some subject matter expertise in order to determine that the answer is actually bad has effectively swamped our volunteer-based quality curation infrastructure.”

Christ, I'm asking for more information. As I said, SO has tons of terrible and incorrect answers, so I want to know more about the impact of ChatGPT answers. Information like the rate at which they're correct vs incorrect, the rate at which they are submitted, and how that compares to normal answers.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#49

Post by fabian2k »

I tried ChatGPT with a few SO questions as input, it was completely missing the point of the questions more often than not. I got 3 bad answers and one correct one out of it.

The scary part was just how confidently incorrect it was. The text looked very good, but there were big errors in there.

I also tried to ask it a scientific question on a pretty niche field, and it produced a very reasonably looking answer. Most of the text was actually correct, if a bit generic. But there was one big factual mistake in there, it gave a value range that is simply wrong for this question.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#50

Post by Ygg2 »

saagarjha wrote: post #39
samcheng wrote: post #26

Earlier quoted context omitted.

Perfect. This kind of junk is going to litter our collective knowledge bases for years. It looks just good enough to be authoritative, but is fundamentally incorrect.

So a Hacker News comment.

Or a Stack Overflow answer.

Or any post on Internet.

Post reply on HN