Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: AI Code Detector – detect AI-generated code with 95% accuracy

code-detector.ai

Post reply on HN
Print view View original

21–30 of 69 posts

Re: Show HN: AI Code Detector – detect AI-generated code with 95% accuracy

#22

Post by johnsillings »

mannicken wrote: post #19

Only Python, TypeScript and JavaScript? Well there go my vibe-coded elisp scripts. I guess it's impossible (or really hard) to train a language-agnostic classifier. Reference, from your own URL here: https://www.span.app/introducing-span-detect-1

I'll let Henry elaborate here, but we think there's a chance that a truly language-agnostic classifier is possible. That being said, the next version of this will support a few more languages: Ruby, C#, and Java.

Re: Show HN: AI Code Detector – detect AI-generated code with 95% accuracy

#26

Post by johnsillings »

Alifatisk wrote: post #21

Very cool piece of tech, I would suggest putting C on the priority list and then Java. Mainly because Unis and Colleges use one of them or both, so that would be a good use case

Totally – we have support for Java, C#, and Ruby in the works.

Edit: since you mentioned universities, are you thinking about AI detection for student work, e.g. like a plagiarism checker? Just curious.

Re: Show HN: AI Code Detector – detect AI-generated code with 95% accuracy

#27

Post by polynomial »

henryl wrote: post #13
jensneuse wrote: post #9

Could I use this to iterate over my AI generated code until it's not detectable anymore? So essentially the moment you publish this tool it stops working?

I'm sure you can but there isn't really an adversarial motive for doing that, I would think :)

Sure there is.

Re: Show HN: AI Code Detector – detect AI-generated code with 95% accuracy

#28

Post by henryl »

mannicken wrote: post #19

Only Python, TypeScript and JavaScript? Well there go my vibe-coded elisp scripts. I guess it's impossible (or really hard) to train a language-agnostic classifier. Reference, from your own URL here: https://www.span.app/introducing-span-detect-1

It's probably impossible to detect ALL languages without training for them specifically, but there's good generalization happening. Our model is a unified model rather than a separate model per language. We started out with language-specific models but found that the unified approach yielded slightly better results in addition to being more efficient to train.
Post reply on HN