Live data from Hacker News

Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

meta.stackoverflow.com

101–110 of 143 posts

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#101

This has the potential to break every message board out there. No offense, but I'll be outta here if it's mostly robots to talk to.

If it's cheap enough, it'll be just like email spam - basically everywhere worth influencing in any way will be flooded. And it'll be much harder to filter than email. One possible solution would be to change basically any community-driven site to be invite-only, and to wield the ban hammer ruthlessly.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#103
post #70

I think it could work - but you'd have to find a way to let ChatGPT exclusively deal with the sort of repeat questions that are rather annoying to human posters - while all the actually interesting, new questions (which are also more likely to cause ChatGPT to create a flawed answer), are reserved for humans. (Also don't let ChatGPT pose as a human - give it it's own user name and automate it.)

If only ChatGPT could close as a duplicate...

But there is an answer suggesting using it: https://meta.stackoverflow.com/a/421836/7884305.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#104
post #23

Earlier quoted context omitted.

Since it is a centralized service provided by OpenAI, they should really provide services (paid or not) that given a text, check if it is generated by ChatGPT recently.

While a great idea, how could this work so that it would be tolerant to publishing just excerpts of the full output or to ignore trivial edits (either way, it could be fooled easily, I guess)?

Adapt some kind of "perceptual hashing" that's used for audio and video fingerprinting - one that works when dealing with partial content.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#105
post #65

Yet another example of AI driving us back to analogue. There's no obvious way of identifying AI content on StackOverflow, and there's a financial imperative to having a high score on there. So one would expect it to get gamed into oblivion with bots. Once that's happened, there ceases to be any social payoff in posting tech info on the net. And so we end of hoarding knowledge and training people in person.

Interesting thought. But what makes you think that it won't be good enough for the majority of people? To some extent, online-only bootcamps are already good enough for a large crowd of devs, while others went to universities and labs to get a much more in depth education.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#106
post #87
post #71

Earlier quoted context omitted.

This is the scary thing about this - I keep asking it questions, and it gives confident, lengthy responses that look perfect. But when you read it thoroughly, you start noticing small but important mistakes that are not obvious at first.

Why have this mountain of noise? It'll end in: a) Wow such a nice tool that generates nice prose for emails and communication! b) Wow, such a nice tool that filters and summarizes the mountains of prose coming into my communication channels! It's as if we're just making the channel broader with less information for no reason.

> It's as if we're just making the channel broader with less information for no reason.

It's the usual: all that effort is generally wasted, because it averages out to zero, but the money is made on high-frequency fluctuations, the momentary imbalances. It's just another hamster wheel for the economy to work, and hopefully produce something useful every now and then as an accidental spinoff.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#107

What is the mechanism by which a text is determined to originate from ChatGPT? This will be crucial for preventing unfavorable training loops among a myriad of other human-led control efforts.

To determine if a post on StackOverflow is generated by ChatGPT, you could look for certain characteristics that are typical of posts generated by the model. For example, ChatGPT posts may contain repetitive or nonsensical phrases, lack coherence or context, or have a distinctive "machine-like" writing style. Additionally, you can check the user profile of the poster to see if it indicates that the user is a language…

You'll get a more concise response if you ask it to actually write a Hacker News comment for you.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#108
post #99
post #60

Just finished Neil Stephenson's Anethem. In it (I'm paraphrasing here) the open internet is destroyed by media companies who flood the internet with "good garbage", that is stuff that is _almost_ correct. It forced people to pay for curated accurate content (that is, pay the same people who generated the good garbage in the first place).

That's basically the Western story of the devil, more relatably portrayed as Sauron during the second age, giving gifts and teaching people, all the while sprinkling the teachings with heretical thoughts until, many generations later, the society was corrupt to the core.

So, we laughed off the warnings that we're blindly attempting to summon a god, and instead we just accidentally created a devil.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#109
post #34

StackOverflow and Google are finished. This is expected and it may not look like it now, but banning an advancement in technology (even temporary) is usually the first step to irrelevance of those pushing back. In a few years from now when ChatGPT and perhaps the much awaited GPT-4 are released, get better, (or even an implementation is open sourced) it will further plummet the usage for SO and Google. The genie is o…

I played with ChatGPT today. It doesn't replace Google or SO today, and based on the types of issues with what it generated, ChatGPT is not going to replace a competent programmer any time soon. Where I fear you might be right though, is that the web in general (and so, Google) and sites like SO with their internal content, will inevitably lose value as people post ChatGPT-generated content which superficially looks…

I woke up today and decided to ask ChatGPT something instead of Googling it. It worked perfectly for my query.

A version of ChatGPT that has access to the web (can crawl, can link to content) will be a big blow for google.

Re: Use of ChatGPT generated text for posts on Stack Overflow is temporarily banned

#110

Earlier quoted context omitted.

To determine if a post on StackOverflow is generated by ChatGPT, you could look for certain characteristics that are typical of posts generated by the model. For example, ChatGPT posts may contain repetitive or nonsensical phrases, lack coherence or context, or have a distinctive "machine-like" writing style. Additionally, you can check the user profile of the poster to see if it indicates that the user is a language…

okay, I did not realise that was GPT until the second last line, GPT seems to have a tendency to "hedge" all it's opinion in a certain way—it very rarely says one thing without adding a "however", "some people" etc.

The problem is, if you prefix the prompt in the right way, it will happily generate you a comment in a completely different style. Like, given this prompt:

> Write a Tweet tht answers the question, "how can you tell if a comment was written by ChatGPT and not a human?"

The first three replies were:

> "If a comment seems overly robotic or generic, it's likely written by ChatGPT rather than a human!" #AI #ChatGPT

> If a comment reads like it was written by a robot and lacks the nuance and creativity of human language, it's likely written by ChatGPT. #AI #chatbot

> "If the comment seems too perfect or robotic in its language and tone, it's likely written by ChatGPT. Look for a lack of personality and human error in the writing." #ChatGPT #AIwriting

When I tried asking it to "Provide a Reddit style answer to the question, ...", it gave me a one-page essay with 5-item bullet point list, which ironically argued - among other things - that one indicator is an answer that's longer / more verbose than what you'd expect.

EDIT: OK, you can say that "it's likely written by..." is a hedge. So I now tried this:

> Write a Tweet that confidently answers the question, "how can you tell if a comment was written by ChatGPT and not a human?"

The third result I got was:

> "Just look for the tell-tale signs of a ChatGPT comment: robotic language, repetitive phrases, and a lack of genuine emotion or personal touch. Trust me, you'll know it when you see it!" #ChatGPT #artificialintelligence

Post reply on HN