Live data from Hacker News

Show HN: Watch a neural net learn to play Snake

ppo.gradexp.xyz

51–56 of 56 posts

Re: Show HN: Watch a neural net learn to play Snake

#52

Earlier quoted context omitted.

maybe because it doesn't understand "done"? perfect play is impossible, random variance will cause scores to drop even if the model plays well and "wins". feels like it would get stuck in a loop trying to improve what can't be improved.

The optimizer doesn't need to understand anything it's just an iterated mathematical construct. The author simply didn't bother to implement the necessary details to ensure numerical stability. Alternatively it might be a problem with the scoring model in the end game.

That is what I thought op was saying when he used the word "understood". No need to jump on people using every day language that is still easily understood in context IMO.

Re: Show HN: Watch a neural net learn to play Snake

#56
post #48

Earlier quoted context omitted.

I see what you are saying but then wouldn’t it miss out on the best strategies, which do require patience and not going straight for the apple?

Maybe you could make it lose points for repeating a board state, I guess.

Ah yes that’s probably the right approach
Post reply on HN