I was thinking, what part of HN comments do you think are already AI-generated?
As a human, I cannot give an accurate estimate. /joke
Stack Overflow questions are being flooded with answers from ChatGPT
21–30 of 342 posts
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#22This is just a preview of things to come. Wait a few weeks until Google is completely swamped with ChatGPT SEO pages barely distinguishable from the real thing. If I worked at search quality at Google, I'd be very worried.
Luckily for them, almost nobody works at search quality at Google.
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#23Earlier quoted context omitted.
> If its working code and indistinguishable from a human answer to anyone reading it These are extremely stringent conditions, though. Convincing-looking-but-wrong answers would arguably be even more damaging than a lack of answers. (I suppose you could argue that these could arise from humans as well as from AGIs. I'm not sure if there's a good counter-argument to that)
I think your two final sentences capture the essence of what I was going to respond. "It doesn't matter if the answer is convincing-looking and wrong. It needs to work / be syntactically correct at a minimum, which OpenAI seems good at. However, the OP and others needs to test and evaluate if the proposed answer solve the original problem. And if its not, it will quickly be revealed as such, and "downvoted" or whatev…
Yeah, absolutely. My position on AGIs for a long long time has been that they're great tools for a) generating insights into a large amount of data very quickly, and b) generating new instances of from examples of to help with exploring the possibility space of ; but that any output or conclusion they generate _must_ be checked by a Human In The Loop, or at the very least their actions must be reversible without damage in the case of error.
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#24Earlier quoted context omitted.
> If its working code and indistinguishable from a human answer to anyone reading it These are extremely stringent conditions, though. Convincing-looking-but-wrong answers would arguably be even more damaging than a lack of answers. (I suppose you could argue that these could arise from humans as well as from AGIs. I'm not sure if there's a good counter-argument to that)
The bot would need to learn as well as a "reasonable human" from being corrected on SO, and also be able to react in a socially appropriate way to correction (both in the subject thread and in future postings), otherwise it is a downgrade, even if initial answer is identical.
My experience with OpenAI is that it is very good at exactly this, because it is so good at understanding context and follow-up questions. I was able to make it produce code that appeared correct, but was basically pseudocode with correct syntax, so it compiles/runs, but does essentially nothing. However, when prompted to actually make working code and explain how and why it works, it does so. And its also socially appropriate, not rude and what else you could/would expect when being called-out or corrected on its bullshit. I can only imagine future versions of the current AI model will be even better at this.
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#25I assume that this is by folks wanting to up their scores. That's a huge problem with "gamification." I'm not especially a fan of the concept, in a venue like SO. I think it has led to a rather nasty community, and I hardly ever go there, anymore. I assume that we'll be seeing a lot of robotic HN content (I would not be surprised if it is already here, but has been sidelined by the mods).
Smaller StackExchange communities don't have this problem from what I can tell. Stack Overflow maybe should be split up into smaller communities.
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#26It seems like there are a few potential negative consequences of using AI-generated answers on Stack Overflow. For one, the quality of the answers may be lower than if they were written by a human. Additionally, if these AI-generated answers become too common, it could potentially lead to a more impersonal and less supportive community on Stack Overflow. Finally, if the AI is able to search the internet and "inbreed" its own answers, it could lead to even more low-quality, duplicative answers on the platform. Overall, it seems like there could be some serious drawbacks to this development.
Note: This answer was generated by ChatGPT after being fed this thread.
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#27I was thinking, what part of HN comments do you think are already AI-generated? As a human, I cannot give an accurate estimate. /joke
[deleted]
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#28This is just a preview of things to come. Wait a few weeks until Google is completely swamped with ChatGPT SEO pages barely distinguishable from the real thing. If I worked at search quality at Google, I'd be very worried.
I am afraid for whats to come. This is truly only the beginning. Good luck everyone. See you on the other side.
Sworn enemies unite against a common foe. This foretaste of AI may be
a timely wake-up call about what technology is doing to us. We may be
forced to start treating each other as humans. In that case, ChatGPT
will be seen as a watershed moment in the retaking of humane
technology.
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#29We need to start developing software to detect AI responses.
To detect a response generated by ChatGPT, we could first analyze the content of the response to see if it contains any unnatural or repetitive language. We could also check the formatting of the response to see if it follows the typical conventions used by human responders on the platform. Additionally, we could check for any unusual patterns in the timestamps of the response, as AI-generated responses may be posted more quickly or regularly than responses written by humans. Finally, we could also use machine learning algorithms to train a model to identify responses generated by ChatGPT based on these and other characteristics.
Quick, someone ask ChatGPT to generate the stubs.
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#30This is just a preview of things to come. Wait a few weeks until Google is completely swamped with ChatGPT SEO pages barely distinguishable from the real thing. If I worked at search quality at Google, I'd be very worried.
That would actually slightly improve Google search results given the generated spam garbage that comes up today.