dumb question but could ML be made to copy an OS? since this has a learning/input ability with rules.
Pac-Man recreated with a GAN trained on 50k game episodes
71–80 of 154 posts
Re: Pac-Man recreated with a GAN trained on 50k game episodes
#72> Trained on 50,000 episodes of the game Meanwhile an actual human will probably need only about 5 games to fully understand how the game works and reacts.
Fundamentally, this is because we have already been trained on years of living in and reacting to the real world, which, to some abstract degree, the game mimicks. The Nvidia model starts with nothing.
This is a tired argument, experiments on humans with random textures show only a 10X slowdown, not 10,000x
Re: Pac-Man recreated with a GAN trained on 50k game episodes
#73So AI can learn to play the games, but can it learn to create them? That is, can it create compelling cultural novelty?
The most successful examples I've heard are computer generated classical music, but generating abstract art like classical music is simpler than generating art that relies on coherent language and narrative, like opera, or the blues, or a good novel.
Re: Pac-Man recreated with a GAN trained on 50k game episodes
#74Please help me understand the point. Is it to show that nVidia chips can be used to create game AI using GANs? Or is it to aid in game design? Wouldn't a human be in a better position to do both?
If I'm understanding correctly, the machine learning model was able to create a game executable from information about a game.
Re: Pac-Man recreated with a GAN trained on 50k game episodes
#75So AI can learn to play the games, but can it learn to create them? That is, can it create compelling cultural novelty? The most successful examples I've heard are computer generated classical music, but generating abstract art like classical music is simpler than generating art that relies on coherent language and narrative, like opera, or the blues, or a good novel.
There has been research on it. I forgot the source and can’t find it easily, but if you email Julian Togelius, he might know. He doesn’t focus on game AI research and is the only name I can remember at the moment.
Edit: oh, Togelius also seemed to have researched it.
https://www.google.com/amp/s/www.technologyreview.com/2017/1...
Re: Pac-Man recreated with a GAN trained on 50k game episodes
#76I've observed an increasing trend with modern AI research that A) It's no longer practical to incorporate into real products given the hardware costs for training and inference. In NLP, large transformer based models can easily occupy a 5 thousand dollar GPU at a paltry 50-60 words per second processing pace. B) The Research often demonstrates things that existing non-ML toolchains were already reasonable at doing wi…
A) is just a sign, that further engineering, both model and framework, is required. Also, 50-60 words per second does not sound too bad. It amounts to 4M words per day. I imagine most people only type a thousand words per day. So with a single GPU you can handle 4000 users (assuming batch-style processing).
B) This specific example actually shows ML toolchains are orders of magnitude better, than existing ones. Imagine you wanted to make a football game from scratch, and this technique would let you do that by just feeding a lot of football game recordings to a program, as opposed to hiring software devs and graphics designers, and iterating for a year.
Re: Pac-Man recreated with a GAN trained on 50k game episodes
#77I've observed an increasing trend with modern AI research that A) It's no longer practical to incorporate into real products given the hardware costs for training and inference. In NLP, large transformer based models can easily occupy a 5 thousand dollar GPU at a paltry 50-60 words per second processing pace. B) The Research often demonstrates things that existing non-ML toolchains were already reasonable at doing wi…
Or, to paraphrase: great paper, no application.
Re: Pac-Man recreated with a GAN trained on 50k game episodes
#78Full article is here:
https://cdn.arstechnica.net/wp-content/uploads/2020/05/Nvidi...
Re: Pac-Man recreated with a GAN trained on 50k game episodes
#79Earlier quoted context omitted.
Something similar to what you describe is already being done. Game video is streamed to a Raspberry Pi Zero that sits between the real mouse and the Gaming PC and adjusts the mouse movements. Google for "Valorant RPi0" for videos to see this in action. Here is an excerpt from a now deleted Reddit comment where the setup is described: > "My pi is connected to my pc as a HID device with all the descriptors matching a l…
There are cheats that work solely off of game recordings?
In many non-fps games of course - even in FPS games you can make an aimbot (admittedly a crappy one) with nothing but autohotkey. The reason is because in most FPS games the enemy is highlighted a specific color, so you just move the mouse until that color is centered and shoot.
Re: Pac-Man recreated with a GAN trained on 50k game episodes
#80I've observed an increasing trend with modern AI research that A) It's no longer practical to incorporate into real products given the hardware costs for training and inference. In NLP, large transformer based models can easily occupy a 5 thousand dollar GPU at a paltry 50-60 words per second processing pace. B) The Research often demonstrates things that existing non-ML toolchains were already reasonable at doing wi…
Or, to paraphrase: great paper, no application.
It really is a great paper, the problem is when your entire field has few real applications but everyone is making too much money to admit that. Cool tech demos like this is awesome as a blog post, but not sure why it's academic...