We stopped AI bot spam in our GitHub repo using Git's –author flag
61–70 of 254 posts
Re: We stopped AI bot spam in our GitHub repo using Git's –author flag
#62Re: We stopped AI bot spam in our GitHub repo using Git's –author flag
#63Seriously. Just ask for a US$10 deposit for the each PR. If the PR is accepted (not even merged, just accepted as "this is a good effort"), give it back. Hell, give double the amount for good effort and you got yourself a cheap way to attract good contributors.
Best case, bots will balk at the payment. Worst case, the funds can be used to hire someone specifically for triage.
Re: We stopped AI bot spam in our GitHub repo using Git's –author flag
#64Makes me wonder if an ELO-based system would work to mitigate these issues. People who merged PR successfully onto a project, that had real issues acknowledged, the quality of their responses measured by other users reactions or something, etc, multiplied possibly by the degree of importance of the project where their activity has been made. Won't be about human vs AI, but actual helpful effective being vs low effort…
ELO is shockingly easy to manipulate. For example there was a literal jail with a decent chess player in it. He created a pool of players who got great ELOs by beating him, then used them to boost his rating higher. Wash, rinse, and repeat. Given any manipulatable scheme, AI will figure out how to manipulate it. For the OP, what happens if a single AI manages to get through to contributor? Then it starts elevating ot…
Re: We stopped AI bot spam in our GitHub repo using Git's –author flag
#65PR spam is a major problems for repo that run bounties. Maybe GitHub should temporarily block accounts from raising PRs if like 95%+ of them are getting rejected.
GitHub has not incentive for blocking AI. It's like asking an ad company to build an adblocker into their browser.
Re: We stopped AI bot spam in our GitHub repo using Git's –author flag
#66'I will take "problems that could be easily be solved by implementing a Pfand system" for $200, Alex.' Seriously. Just ask for a US$10 deposit for the each PR. If the PR is accepted (not even merged, just accepted as "this is a good effort"), give it back. Hell, give double the amount for good effort and you got yourself a cheap way to attract good contributors. Best case, bots will balk at the payment. Worst case, t…
Re: We stopped AI bot spam in our GitHub repo using Git's –author flag
#67Makes me wonder if an ELO-based system would work to mitigate these issues. People who merged PR successfully onto a project, that had real issues acknowledged, the quality of their responses measured by other users reactions or something, etc, multiplied possibly by the degree of importance of the project where their activity has been made. Won't be about human vs AI, but actual helpful effective being vs low effort…
It's Elo not ELO. Elo is not an acronym. https://en.wikipedia.org/wiki/Elo_rating_system
Re: We stopped AI bot spam in our GitHub repo using Git's –author flag
#68not just this issue — but the entire repo.
contributors like @ethanwater, @developerfred, and @Geetk172 — people actively working on bounties — were getting buried.
two identity fields — author and committer — and they can be different people.
metric growth — a substantial part of
Re: We stopped AI bot spam in our GitHub repo using Git's –author flag
#69so...they are manually re-setting the "interaction limits" over and over again, since they are only temporary? why not use hooks to automatically reject issue comments / PRs etc. from users that didnt go through onboarding, rather than repurposing GH features that aren't really designed for that use (and are hence in danger of being changed someday)?
Re: We stopped AI bot spam in our GitHub repo using Git's –author flag
#70'I will take "problems that could be easily be solved by implementing a Pfand system" for $200, Alex.' Seriously. Just ask for a US$10 deposit for the each PR. If the PR is accepted (not even merged, just accepted as "this is a good effort"), give it back. Hell, give double the amount for good effort and you got yourself a cheap way to attract good contributors. Best case, bots will balk at the payment. Worst case, t…