Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

My Tamagotchi is an RL agent playing Slither.io

nkasmanoff.github.io

Post reply on HN
Print view View original

1–10 of 20 posts

Re: My Tamagotchi is an RL agent playing Slither.io

#2

Post by giancarlostoro »

Corporate firewall is blocking this since its a "newly registered domain" but I wanted to note that Tamagotchi got me to revisit Digimon after I learned that Digimon was created as a way for Bandai to sell to boys. Color me surprised when I learned that Tamagotchi was considered for girls, but I played with mine like there was no tomorrow, with the Pokemon hype of the late 90s it came to many of us at the right time.

Surprisingly, and I just looked it up, you can buy the original classic ones for about $20 straight off Amazon.

Re: My Tamagotchi is an RL agent playing Slither.io

#5

Post by jeremysalwen »

As someone who implemented some RL algorithms and applied them to a real world game, (including all the ones mentioned in the article), I would be surprised if the implementation is not buggy. That is one of the most striking things about RL, the extent to which it is hard to find bugs, since they generally only degrade the performance instead of causing a crash or obviously wrong behavior. The fact that he doesn't mention a massive amount of time spent debugging, and the longish list of things that were tried that really should have worked but didn't, suggests to me it's probably still buggy. I suppose it is possible that LLMs could be particularly good at RL code since it's seen it repeated so many times... But I would be skeptical without hard evidence.

Re: My Tamagotchi is an RL agent playing Slither.io

#6

Post by nkaz123 »

giancarlostoro wrote: post #2

Corporate firewall is blocking this since its a "newly registered domain" but I wanted to note that Tamagotchi got me to revisit Digimon after I learned that Digimon was created as a way for Bandai to sell to boys. Color me surprised when I learned that Tamagotchi was considered for girls, but I played with mine like there was no tomorrow, with the Pokemon hype of the late 90s it came to many of us at the right time.…

I recently updated my .github.io to route to a domain name I purchased so that could be why it's getting blocked right now.

This comment alone has more tamagotchi lore than my post as a disclaimer in case I saved you a read haha.

Re: My Tamagotchi is an RL agent playing Slither.io

#7

Post by treyd »

I had this idea during the pandemic 5 years ago now, and even did some of that work to figure out the variables I'd need to extract to make it work, but I never found the time/motivation to work on it for real. Really happy to see someone put in the effort.

Re: My Tamagotchi is an RL agent playing Slither.io

#8

Post by nkaz123 »

jeremysalwen wrote: post #5

As someone who implemented some RL algorithms and applied them to a real world game, (including all the ones mentioned in the article), I would be surprised if the implementation is not buggy. That is one of the most striking things about RL, the extent to which it is hard to find bugs, since they generally only degrade the performance instead of causing a crash or obviously wrong behavior. The fact that he doesn't m…

I accepted the bugginess in the browser game as unavoidable, and probably had too much faith in the LLM implementations, but I did a bit more troubleshooting than mentioned. The progressive improvement over episodes (and intuitively that PPO > the others) gave me some confidence, and I've since used a similar setup on 2048 with more results showing improvement over episode: https://wandb.ai/noahpunintended/2048-raspberry-pi?nw=nwuser...

Re: My Tamagotchi is an RL agent playing Slither.io

#9

Post by breakds »

The sample efficiency of the RL algorithm, even for simple games, is not very good. This usually means that we will need a lot of episodes for the policy to learn to excel. Being able to run policy in an environment that can parallel and accelerate could be very helpful for the improvement - for example running a batch of browsers or tabs simultaneously :)
Post reply on HN