Yesterday I was searching the internet for the opinion that George Orwell had when he returned from his fight in the Spanish civil war. I was surprised that the first answer I found was on Stack Overflow. I do not understand what is happening.
Stack Overflow questions are being flooded with answers from ChatGPT
131–140 of 342 posts
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#132This is just a preview of things to come. Wait a few weeks until Google is completely swamped with ChatGPT SEO pages barely distinguishable from the real thing. If I worked at search quality at Google, I'd be very worried.
> SEO pages I think GPT could improve things in this regard. It's already a huge garbage pile, so we might as well go all in and at least generate better garbage.
The current AI generated SEO content is relatively easy to detect because much of it tends to make incoherent statements. We don't want better AI bots feeding us lies that are hard to detect even for competent people who know to be wary of it.
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#133Earlier quoted context omitted.
> I would not be surprised if it is already here, but has been sidelined by the mods I can virtually guarantee you that there's been a nontrivial amount of GPT-generated content on HN that has not been caught by mods since ChatGPT, and likely since GPT-2/3, as well. Dang (and the other one whose tag I can't recall) already have their hands full trying to keep the tone civil across thousands (tens of thousands?) of co…
> some humans actually do write like these newer language models, after all Wouldn't it be more accurate to say these newer language models actually write like humans? Or is there a subset of the population intentionally trying to write in the way that these language models write.
Sure, you can also say that some language models write like humans - however, even pre-GPT-2, I read several high-schooler's essays that read very much like these ML-generated products, so even if you don't believe that the relationship is transitive, I think you can say that the relationship is true in both directions.
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#134Oh dear - basically if the answer is good then it's from ChatGTP... Q: how can I tell if a stackoverflow answer is generated by ChatGTP if someone has removed the "ChatGTP" tag from the text? A: One way to tell if a StackOverflow answer is generated by ChatGTP is to look for certain characteristics in the answer. ChatGTP answers tend to be concise and to the point, often providing code snippets or specific instructio…
Notably, it didn't correct "ChatGTP vs ChatGPT". If you still have this open, could you ask it what GTP stands for?
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#135Earlier quoted context omitted.
Reddit and Twitter are going to be overwhelmed with bots indistinguishable from humans.
A lot of reddit and twitter posts are already just people regurgitating and rehashing what they have heard/read from others, mostly without a lot of critical thought. Is this really going to be very different?
You have a point. But now it will happen at scale quickly, cheaply, and easily for an order of magnitude more impact.
Beyond these text-based social media platforms, I could see the next generation of TikTok/Instagram "influencer" social media adopting AI rails so there's next to zero effort put into creation. The photography, trends, personalities - all of it - will be generated.
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#136Earlier quoted context omitted.
Can’t we have ChatGPT identify output of ChatGPT, adversarily?
It confirmed it when I asked: --> Was the following paragraph generated by the OpenAI Assistant: "It seems like there are a few potential negative consequences of using AI-generated answers on Stack Overflow. For one, the quality of the answers may be lower than if they were written by a human. Additionally, if these AI-generated answers become too common, it could potentially lead to a more impersonal and less suppo…
"It is likely that this text was not written with OpenAI Assistant."
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#137Earlier quoted context omitted.
The most recent update also managed to rank ML generated content above written content in many instances, compounding the problem. I absolutely expect a carpet bombing of SEO results with spam.
Hasn't that already been the case for years?
Depending on the query, yes. Google search has different ranking strategies for different queries, and some of them seem more robust to simple SEO tactics than others. I think the ranking strategy for e-commerce searches and product reviews does a poor job with spam sites, but the ranking strategy for news queries works pretty well, typically providing timely and relevant answers from reputable sources.
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#138Re: Stack Overflow questions are being flooded with answers from ChatGPT
#139This kind of looks like the singularity is approaching/just beginning.
The only thing we can be sure of, is that whatever we can imagine is already behind what the AI will become.
Re: Stack Overflow questions are being flooded with answers from ChatGPT
#140Earlier quoted context omitted.
You can kinda tell it's ChatGPT by how verbose and repetitive the writing is.
Before reading any words, I guessed just by seeing how long the paragraph was. Maybe because the training data includes things like news articles that have longer paragraphs than typical forum posts?
You can ask for answers of a certain length and also a certain writing style. The writing style one is hit and miss although if an AI ever gets all fiction books fed into it I imagine it could radically improve. Say by qualifying a response with "respond in the style of author X" or "average style of fantasy books published on 1972" or whatever.