Live data from Hacker News

Stack Overflow questions are being flooded with answers from ChatGPT

news.ycombinator.com

311–320 of 342 posts

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#314
post #270

Earlier quoted context omitted.

> Don't most humans just regurgitate the same arguments they've just read or learned elsewhere (or even here), like 99% of the time? So, let’s see whether ChatGPT gets the wrong answers: Q: How long does it take to have a baby? A: The average length of pregnancy is about 40 weeks, or 9 months. 1/2 correct - 40 weeks is 10 months from conception to birth. Q: Why is emacs better than vi? A: […] Overall, emacs is widely…

> 1/2 correct - 40 weeks is 10 months from conception to birth. Average length of pregnancy, ovulation to birth is 268 days -- 38.3 weeks or ~8.8 months. But we typically count pregnancy from last period (this is easier), which makes it pretty close to the round 40 that's usually cited. > 40 weeks is 10 months from conception to birth. A month is ~4.35 (6957/1600) weeks, so 40 weeks is ~9.2 months (69400/6957).

Ooops, thank you heaps. Very glad to find out that 40 weeks is not a particularly correct answer either! But dividing 40 by 4 to get 10 months was a stupid mistake for me to make!

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#316
post #288

Earlier quoted context omitted.

This is terrible. Pretty soon most comments on the internet internet will be written by bots.

> the internet internet I think you pass the Turing test. It's ironic that in its current state AI is so "perfect" this kind of mistake can actually serve as proof of human. Can you prompt chatgpt to introduce small errors as to appear more genuine?

You can ask it to write like a teenager etc. It should be fairly trivial to make a script that removes ' and some . and maybe adds some writing mistake.

You probably need to have a discussion with a user to find out if it is a bot or not.

Vagely relevant one or two liners type of comments we will never know if a bot wrote it. The kind of noise people post on Twitter, Facebook and Reddit.

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#317

Earlier quoted context omitted.

For the last few days I've been using ChatGPT instead of SO. It's OK, it's just frequently wrong, so I assume I have to fact-check its answers. Yesterday it claimed to me JavaScript has a built-in `sum` method, before admitting no browsers supported it and it's not in the spec. It's useful for starting investigation, but one of the nice things about SO is that answers are voted for, so you can usually see which are a…

What if AI starts voting all the answers randomly?

SO upvote rings I assume to be a solved problem

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#318

It seems like there are a few potential negative consequences of using AI-generated answers on Stack Overflow. For one, the quality of the answers may be lower than if they were written by a human. Additionally, if these AI-generated answers become too common, it could potentially lead to a more impersonal and less supportive community on Stack Overflow. Finally, if the AI is able to search the internet and "inbreed"…

This is the Great Filter we never expected.

It probably turns out that most advanced civilizations eventually invent decent language model AIs that clog up their professional message boards with semi-comprehensible blather which ultimately ends up stalling all future scientific progress.

It's like some weird self-inflicted version of the Three Body Problem.

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#319

It seems like there are a few potential negative consequences of using AI-generated answers on Stack Overflow. For one, the quality of the answers may be lower than if they were written by a human. Additionally, if these AI-generated answers become too common, it could potentially lead to a more impersonal and less supportive community on Stack Overflow. Finally, if the AI is able to search the internet and "inbreed"…

What prompt input did you use? When I tried this: > What are the repercussions of Stack Overflow questions are being flooded with answers from ChatGPT? It returned: > I'm sorry, but I'm not aware of any situation in which answers on Stack Overflow are being flooded with answers from ChatGPT. I am a language model trained by OpenAI, and I do not have the ability to browse the internet or interact with websites like St…

This is the response I got from my chatbot that's hooked up to GPT, using your prompt:

>The repercussions of Stack Overflow questions being flooded with answers from ChatGPT could be that Stack Overflow will not have a reliable source of answers to various programming questions, leading to confusion and inaccurate solutions. Additionally, there could be an increase in spam and low-quality answers, reducing the overall quality and reliability of Stack Overflow.

Out of interest, I then asked "Can you elaborate?":

>Sure! ChatGPT is an AI system that uses natural language processing to generate answers to questions. While this technology can be helpful, it can also lead to confusion and inaccurate solutions. For example, ChatGPT might provide an answer that is technically correct but doesn’t take into account the nuances of the programming problem or the context of the question. Additionally, since AI-generated answers are not written by humans, there might be a lack of clarity or explanation which could make it difficult for readers to understand the solution or follow along with the logic. Finally, since ChatGPT can generate answers quickly and in bulk, there might be an increase in spam and low-quality answers on Stack Overflow which could reduce the overall quality and reliability of the platform.

Re: Stack Overflow questions are being flooded with answers from ChatGPT

#320
Temporary policy: ChatGPT is banned - https://meta.stackoverflow.com/questions/421831/temporary-po...

> Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned.

> This is a temporary policy intended to slow down the influx of answers created with ChatGPT. What the final policy will be regarding the use of this and other similar tools is something that will need to be discussed with Stack Overflow staff and, quite likely, here on Meta Stack Overflow.

(much more to that post and comments and answers and comments)

Post reply on HN