Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Stack Overflow questions are being flooded with answers from ChatGPT

news.ycombinator.com

Post reply on HN
Print view View original

11–20 of 342 posts

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#11

Post by scubbo »

hxugufjfjf wrote: post #5
brindidrip wrote: post #3

Earlier quoted context omitted.

Here is an example that I noticed: https://stackoverflow.com/questions/74678832/change-text-col...

If its working code and indistinguishable from a human answer to anyone reading it, are there really any repercussions? I guess problems would surface if the model at some point is allowed to search the internet and start inbreeding its own answers.

> If its working code and indistinguishable from a human answer to anyone reading it

These are extremely stringent conditions, though. Convincing-looking-but-wrong answers would arguably be even more damaging than a lack of answers.

(I suppose you could argue that these could arise from humans as well as from AGIs. I'm not sure if there's a good counter-argument to that)

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#12

Post by seydor »

senko wrote: post #7

This is just a preview of things to come. Wait a few weeks until Google is completely swamped with ChatGPT SEO pages barely distinguishable from the real thing. If I worked at search quality at Google, I'd be very worried.

Chatgpt SEO is no different from existing filler SEO. If google falls for the latter, why shouldn't it fall for the former

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#13

Post by echelon »

senko wrote: post #7

This is just a preview of things to come. Wait a few weeks until Google is completely swamped with ChatGPT SEO pages barely distinguishable from the real thing. If I worked at search quality at Google, I'd be very worried.

Reddit and Twitter are going to be overwhelmed with bots indistinguishable from humans.

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#14

Post by scarmig »

seydor wrote: post #12
senko wrote: post #7

This is just a preview of things to come. Wait a few weeks until Google is completely swamped with ChatGPT SEO pages barely distinguishable from the real thing. If I worked at search quality at Google, I'd be very worried.

Chatgpt SEO is no different from existing filler SEO. If google falls for the latter, why shouldn't it fall for the former

ChatGPT SEO is higher quality than existing filler SEO and probably quicker and cheaper to generate.

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#15

Post by sgc »

scubbo wrote: post #11
hxugufjfjf wrote: post #5

Earlier quoted context omitted.

If its working code and indistinguishable from a human answer to anyone reading it, are there really any repercussions? I guess problems would surface if the model at some point is allowed to search the internet and start inbreeding its own answers.

> If its working code and indistinguishable from a human answer to anyone reading it These are extremely stringent conditions, though. Convincing-looking-but-wrong answers would arguably be even more damaging than a lack of answers. (I suppose you could argue that these could arise from humans as well as from AGIs. I'm not sure if there's a good counter-argument to that)

The bot would need to learn as well as a "reasonable human" from being corrected on SO, and also be able to react in a socially appropriate way to correction (both in the subject thread and in future postings), otherwise it is a downgrade, even if initial answer is identical.

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#16

Post by ChrisMarshallNY »

I assume that this is by folks wanting to up their scores.

That's a huge problem with "gamification." I'm not especially a fan of the concept, in a venue like SO. I think it has led to a rather nasty community, and I hardly ever go there, anymore.

I assume that we'll be seeing a lot of robotic HN content (I would not be surprised if it is already here, but has been sidelined by the mods).

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#17

Post by Yuyudo_Comiketo »

Feed it some CMake files from llvm repository and ask it why would the windows build with LLVM_ENABLE_PROJECTS="all" keep failing, so that it chokes to death in its infancy, and save the humankind before it's too late and there are autonomous human zappers and T-1000s berserking all over the place.

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#19

Post by hxugufjfjf »

scubbo wrote: post #11
hxugufjfjf wrote: post #5

Earlier quoted context omitted.

If its working code and indistinguishable from a human answer to anyone reading it, are there really any repercussions? I guess problems would surface if the model at some point is allowed to search the internet and start inbreeding its own answers.

> If its working code and indistinguishable from a human answer to anyone reading it These are extremely stringent conditions, though. Convincing-looking-but-wrong answers would arguably be even more damaging than a lack of answers. (I suppose you could argue that these could arise from humans as well as from AGIs. I'm not sure if there's a good counter-argument to that)

I think your two final sentences capture the essence of what I was going to respond. "It doesn't matter if the answer is convincing-looking and wrong. It needs to work / be syntactically correct at a minimum, which OpenAI seems good at. However, the OP and others needs to test and evaluate if the proposed answer solve the original problem. And if its not, it will quickly be revealed as such, and "downvoted" or whatever stackoverflow functionality exists to indicate bad answers. This applies to both human and AI-generated answers."

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#20

Post by brindidrip »

senko wrote: post #7

This is just a preview of things to come. Wait a few weeks until Google is completely swamped with ChatGPT SEO pages barely distinguishable from the real thing. If I worked at search quality at Google, I'd be very worried.

I am afraid for whats to come. This is truly only the beginning. Good luck everyone. See you on the other side.
Post reply on HN