Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

DetectGPT: Zero-Shot Machine-Generated Text Detection

ericmitchell.ai

Post reply on HN
Print view View original

51–60 of 71 posts

Re: DetectGPT: Zero-Shot Machine-Generated Text Detection

#51

Post by Teever »

sublinear wrote: post #45
chrisshroba wrote: post #40

Earlier quoted context omitted.

If an AI can be trained on the internet, it can be trained on a textbook or lecture notes. I think it’s shortsighted to insist that AI won’t replace experts based on the training sets that AIs are currently being trained on.

Who writes the books and lectures? This is literally chicken and egg. Can't have eggs without chickens. Can't have chickens without eggs. This is not an oversimplification.

Yes, now you're getting it.

What happens when the AI can write itself? What happens when it can design its own hardware? And assemble it?

What have we created when it is fully capable of self replication?

Re: DetectGPT: Zero-Shot Machine-Generated Text Detection

#52

Post by sublinear »

Teever wrote: post #51
sublinear wrote: post #45

Earlier quoted context omitted.

Who writes the books and lectures? This is literally chicken and egg. Can't have eggs without chickens. Can't have chickens without eggs. This is not an oversimplification.

Yes, now you're getting it. What happens when the AI can write itself? What happens when it can design its own hardware? And assemble it? What have we created when it is fully capable of self replication?

Stagnant crap nobody wants?

Re: DetectGPT: Zero-Shot Machine-Generated Text Detection

#53

Post by fooker »

sublinear wrote: post #46
lostoldsession wrote: post #42

Earlier quoted context omitted.

>AI will never replace experts Just like it will never beat a top ranked GO player.

Go has static rules that can be mastered and a finite number of games possible. Expertise is always evolving.

> a finite number of games possible.

Effectively infinite with modern hardware. AI did not solve Go by making an effort to explore the state space. That's what's amazing about it.

Re: DetectGPT: Zero-Shot Machine-Generated Text Detection

#54

Post by sebzim4500 »

sublinear wrote: post #46
lostoldsession wrote: post #42

Earlier quoted context omitted.

>AI will never replace experts Just like it will never beat a top ranked GO player.

Go has static rules that can be mastered and a finite number of games possible. Expertise is always evolving.

There are vastly more possible games than atoms in the observable universe. The fact that it is finite is irrelevant.

Re: DetectGPT: Zero-Shot Machine-Generated Text Detection

#55

Post by sebzim4500 »

wwarner wrote: post #25
The_Colonel wrote: post #15

I can't judge the capabilities of this tool, but I can't help but be skeptical on the mid-long term prospects. The fakes (text, audio, video) will improve to the point of being virtually unrecognizable from real material, no matter how good your fake detection is.

Can some chess players detect when an opponent is using stockfish? Yes, if they’re Magnus Carlsen and memorized a particular line of play. This is a bit like that. But yes, I suppose when these tools become so fluent that they basically never need to use the same pattern twice, we’re toast.

Not really comparable IMO. Stockfish is not built to resemble human play and the move times give away a ton of information. A better comparison would be if a top player could tell when they are looking at games played by Maia.

https://maiachess.com/

Re: DetectGPT: Zero-Shot Machine-Generated Text Detection

#56

Post by sebzim4500 »

sublinear wrote: post #29
lostoldsession wrote: post #18

Is there really something of value to be had by fighting a war against the coming tide of AI that can spit out whatever you ask for? To me it looks like old world professors calling the council because the abacus is under threat by the calculator, and we need to ensure the students are absolutely not using the calculator for their abacus studies. This all being despite the fact that society at large is moving as fast…

> I'm still gonna chose my AI consultant over you in 5-10 years. AI will never replace experts. Someone still has to curate the firehose of information returned. What's the point then? AI can only interpolate a response from internet sources, and claims of plagiarism are already coming hard. The internet was never a good source of expertise.

What does 'never' mean here. Do you literally mean that it can't happen even if human society progresses for another millenia? Or just that it won't happen in your career. The latter is somewhat plausible to me, but the former is only happening if there is a civilization ending catastrophe.

Re: DetectGPT: Zero-Shot Machine-Generated Text Detection

#57

Post by a257 »

sublinear wrote: post #29
lostoldsession wrote: post #18

Is there really something of value to be had by fighting a war against the coming tide of AI that can spit out whatever you ask for? To me it looks like old world professors calling the council because the abacus is under threat by the calculator, and we need to ensure the students are absolutely not using the calculator for their abacus studies. This all being despite the fact that society at large is moving as fast…

> I'm still gonna chose my AI consultant over you in 5-10 years. AI will never replace experts. Someone still has to curate the firehose of information returned. What's the point then? AI can only interpolate a response from internet sources, and claims of plagiarism are already coming hard. The internet was never a good source of expertise.

For this to remain true for the indefinite future we must assume that strong AI is strictly impossible. Our scientific knowledge today does not suggest that this is the case.

Re: DetectGPT: Zero-Shot Machine-Generated Text Detection

#58

Post by tarkin2 »

sublinear wrote: post #47
sirsinsalot wrote: post #39

Back in the day I made my money cleaning up software projects where outsourcing to India, Romania and Brazil had gone horribly wrong and burned through piles of cash with very poor results to show for it. I suspect the incoming software development youth will be able to make their early money cleaning up the mess of AI application to software development.

Nobody is ever going to ship unreviewed code. It doesn't matter if a human or a robot wrote it. Someone also has to write acceptance criteria beyond a mere prompt for a chat bot. Someone has to approve it all, and it's not going to be a non-technical person. Someone also has to test it. Someone also has to integrate it with the rest of the solution. Code has dependencies and you can't manage all of them with AI alone…

I think you overestimate how a lot of software is and, in particular, will be created.

Re: DetectGPT: Zero-Shot Machine-Generated Text Detection

#59

Post by gdubs »

lostoldsession wrote: post #18

Is there really something of value to be had by fighting a war against the coming tide of AI that can spit out whatever you ask for? To me it looks like old world professors calling the council because the abacus is under threat by the calculator, and we need to ensure the students are absolutely not using the calculator for their abacus studies. This all being despite the fact that society at large is moving as fast…

I feel you — but there's another possible reason, which would be to (optionally) separate out the AI generated content from future model training.
Post reply on HN