Live data from Hacker News

The Full Chess Cheating Report of Hans Neiman

chess.com

341–350 of 486 posts

Re: The Full Chess Cheating Report of Hans Neiman

#341
post #27

This report provides a detailed background of Hans' potential cheating, and detailed breakdowns of certain aspects of chess.com's cheat-detection methodology, including previously unknown (or little known) methods such as window focus change event monitoring and post-focus-change move analysis.[1] The report also reveals Niemann's engine move correlations alongside over two dozen chess Grandmasters who have admitted…

Tracking window focus change is not a good deterrent.

Re: The Full Chess Cheating Report of Hans Neiman

#342

Earlier quoted context omitted.

That's a generic AI. I would be very surprised you could get it to work accurately for games and hyper specific the heads of (possibly non-human)models. The box you see in the marketing material is completely useless for this use case. Besides how do you get the data to your standard second PC, scale the input the USB thing expects. Send it over USB and back, and then you have to send it to a custom mouse that receiv…

7ms isn't going to be the bar. Human reaction times are in the 150+ms range, you have 20x your budget. I agree it's still tough though, most I/O paths on generic hardware will have buffers at every step that you'll have to fight to eliminate.

7ms is enough. But that is one in a chain of latencies. 150ms is way too long if you want your trigger to be effective. In 150ms the enemy has moved out of your crosshair. Humans deal with that with dynamic adjustment but the AI will just click the mouse. I'd think you'd need to hit less then 25ms end to end and even that might not be enough for far away targets.

Re: The Full Chess Cheating Report of Hans Neiman

#343

Earlier quoted context omitted.

That's a generic AI. I would be very surprised you could get it to work accurately for games and hyper specific the heads of (possibly non-human)models. The box you see in the marketing material is completely useless for this use case. Besides how do you get the data to your standard second PC, scale the input the USB thing expects. Send it over USB and back, and then you have to send it to a custom mouse that receiv…

If you want absolutely olympic response times (110-120ms), it is a little tight but nowhere near impossible. 7ms as the other poster says is absolutely insane. Most videogames will already trigger on consistent peak human response times, so you'll want to trim down your bot to go to a more average person (160ms, maybe a bit higher) to fly under all the heuristics they might (but probably don't) use. Plenty of time to…

7ms is enough. But that is one in a chain of latencies. 110ms is way too long if you want your trigger to be effective. In 110ms the enemy has moved out of your crosshair. Humans deal with that with dynamic adjustment but the AI will just click the mouse. I'd think you'd need to hit less then 25ms end to end and even that might not be enough for far away targets.

Re: The Full Chess Cheating Report of Hans Neiman

#344
post #192

Earlier quoted context omitted.

It's not hard to make cheating tools, it's hard to run them on the same hardware as the game and not get caught. Chess cheating tools don't need to be on the same hardware, so they're not detectable in the same ways.

It is not hard to run cheats for basically any game that uses video on another machine. Just a little more expensive (i.e. it is harder for someone in high school, but not anyone over 20).

Due to the need for real-time input that's just not true.

Re: The Full Chess Cheating Report of Hans Neiman

#345
post #174

Earlier quoted context omitted.

>>Online chess is bigger than ever, and some kind of botting/cheating is possible for virtually every e-sport (indeed I'd say many are easier than chess). I think it's the other way, chess is about as easy to cheat as it gets. With chess you can have a perfectly usable cheating system that isn't on the same computer at all - computer A is clean, and is where you actually play on chess.com, computer B is where you ent…

Yeah chess is the perfect type of game for cheating - it has a tiny (relatively) gamestate, perfect information, and it's turn-based. At the level of chess player we're talking about it's sorta trivial for them to almost immediately memorize a boardstate.

> At the level of chess player we're talking about it's sorta trivial for them to almost immediately memorize a boardstate.

And the rest! I'm pretty crap (hovering 750-850 on chess.com, idk if I play enough for it to be accurate though, probably lower) but I was still thoroughly impressed when I got thrashed by someone (~1200) playing the entire game in their head. As in I had a local game running on my phone, called out my moves, entered his, and he never saw the board, just held it in his head. Thrashed me.

(And there was background conversation going he'd occasionally chime into, ordering pizzas, etc. Ridiculous.)

Re: The Full Chess Cheating Report of Hans Neiman

#346

Earlier quoted context omitted.

It is not hard to run cheats for basically any game that uses video on another machine. Just a little more expensive (i.e. it is harder for someone in high school, but not anyone over 20).

Due to the need for real-time input that's just not true.

There are/have been elaborate cheating setups for online shooters that involved a second computer using the VGA or HDMI video stream.

It’s doable to get around kernel detection tools.

Re: The Full Chess Cheating Report of Hans Neiman

#347
post #155

Earlier quoted context omitted.

In my opinion, this sort of ad-hoc stereotyping weakens the rest of the analysis. There are plenty of counterexamples. Anand, a former world champion, became a GM at age 19 and is still ranked World No. 9 currently (at age 52). Ding Liren (Current No. 2) became a GM at 17. Grischuk (currently No. 17, peak No.3) became a GM at 17. All three have crossed 2800 ELO at some point. I hope this is not the sort of analysis t…

Yea generally I wouldn't characterise the report as being a glimmering indication of the scientific quality of the chess.com cheat detection team. Even the graphs look a lot like copy-paste jobs from excel, which is fine obviously, but not the sort of thing I'd expect competent scientists/data-scientists/developers to be doing, especially for a big public report where some of the formatting issues are just about read…

Good design skills have zero correlation with good data analysis skills.

Re: The Full Chess Cheating Report of Hans Neiman

#348
post #6
post #5

So page 9 from the last paragraph is interesting. Chess.com basically indicate that apart from Hans, a number of highly rated players (including higher than Hans) have been caught and admitted to cheating. I haven't gone over the report thoroughly, but it's clearly focused on Hans's conduct and not so much on the state of play regarding online cheating, which is, even by Magnus's statement, the chief focus of all of…

> Using a computer engine is part of learning and preparing in chess (AFAICT). What other sport has a similar issue where an extremely useful and essential and highly available tool in the sport is considered cheating based entirely on using it within the narrow window of a game? Of course it was going to leak into play in online games where you only have the data feed of moves and nothing else connecting the players…

Some of the Dota cheats use methods in which subtle bits of what should be private information are made public, although not always in a nice/easy way for humans to see. For example some animations and particle effects are visible through the fog of war. Another interesting situation (which I think was recently fixed?) was a bitmap stored on a unit (for example, your hero) for visibility checks by each faction (as in, which factions could see you). You could thus tell if you were visible, and hence detect enemy vision.

Re: The Full Chess Cheating Report of Hans Neiman

#349

Earlier quoted context omitted.

It's not just AI and e-sports either Fishermen Team Accused of Cheating by Stuffing Fish With Weights https://www.si.com/extra-mustard/2022/10/01/fishermen-team-a...

This however is easily detectable. It is undetectable whether I have a second device showing me calculations of a different engine.

From the article they describe many ways they can cheat in fishing (e.g. putting ice in that then melts) that aren't so easy to catch.

If there is a way to cheat, someone will inevitably give it a go with enough incentives. Cheating is the meta-sport and I would think no sport could ever be completely free of it.

Re: The Full Chess Cheating Report of Hans Neiman

#350
post #122

Earlier quoted context omitted.

Quoted post unavailable.

> Shall we compile a 72 page report on Silicon Valley CEOs who have lied? I am not even a little averse to that

We could start with examining the fact that Dlugy was promised privacy, but then chess.com leaked the correspondence to vice.com.

Or why exactly the two persons Carlsen mentioned were exposed, but not the other GMs who cheated.

Post reply on HN