Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2
1–10 of 227 posts
Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2
#2This is a project I've been working on for the past several months and it has blown me away with what it can do. Definitely recommend trying it out.
I think the coolest thing about it is in any other game you are constrained in what you can do by what the developers programmed in, but here you can literally do anything you can imagine and the game will play off of it.
Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2
#3That’s really fascinating, but also really lonely sounding since you know the text is being generated in response to what you say, not actually progressing you through the game’s internal state that someone carefully crafted for you
Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2
#4A plot that sounds really neat while you're in the middle of it, but afterwards doesn't really make any sense — sounds a bit like a J.J. Abrams production.
I don't mean that flippantly, I'm serious. Sounds like GPT-2 might be really good at producing an enjoyable experience, even if there's no underlying structure. What would be really cool would be to add some sort of generated structure as well. Can GPT-2 be used to stitch together plot elements, or would a naive Markov model work for that?
Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2
#5That’s really fascinating, but also really lonely sounding since you know the text is being generated in response to what you say, not actually progressing you through the game’s internal state that someone carefully crafted for you
Yeah definitely. It does lack the same sense of progression that you have with a game someone carefully crafted, it's almost more like collaborative storytelling than a game in that sense. It's pretty cool to see the adventures you end up playing with it though.
Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2
#6The state of the world doesn't seem to be consistent between actions. Got stuff like "someone calls out to you" -> say hello -> "person notices you for the first time and says 'I didn't see you there' "
And stuff like "There is someone to your left" -> go right -> "you go right towards the person".
Also sometimes the game seems to do something completely different from what I say. Is it actually reacting to my commands, or is it just doing what it thinks the player is likely to do, and then retroactively merging the resulting text with what you initially commanded it to do?
Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2
#7A plot that sounds really neat while you're in the middle of it, but afterwards doesn't really make any sense — sounds a bit like a J.J. Abrams production. I don't mean that flippantly, I'm serious. Sounds like GPT-2 might be really good at producing an enjoyable experience, even if there's no underlying structure. What would be really cool would be to add some sort of generated structure as well. Can GPT-2 be used t…
Yeah that's a really good future/research question. I've thought some about how you could do more structured generation. Maybe you could do some kind of reverse summarization, where you take a plot outline and expand out the details would be really interesting to try out? It's still not clear the best way to do structured text generation.
Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2
#8The state of the world doesn't seem to be consistent between actions. Got stuff like "someone calls out to you" -> say hello -> "person notices you for the first time and says 'I didn't see you there' " And stuff like "There is someone to your left" -> go right -> "you go right towards the person". Also sometimes the game seems to do something completely different from what I say. Is it actually reacting to my comman…
Yeah there's definitely times where it's not as coherent as you would hope, other times though it blows me away with certain adventures.
Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2
#9The state of the world doesn't seem to be consistent between actions. Got stuff like "someone calls out to you" -> say hello -> "person notices you for the first time and says 'I didn't see you there' " And stuff like "There is someone to your left" -> go right -> "you go right towards the person". Also sometimes the game seems to do something completely different from what I say. Is it actually reacting to my comman…
GPT-2 has had these consistency issues from the very first demo. The things it gets right are incredibly impressive (orc who can't count -> use math to confuse orc -> orc starts fighting with other orcs).
Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2
#10The state of the world doesn't seem to be consistent between actions. Got stuff like "someone calls out to you" -> say hello -> "person notices you for the first time and says 'I didn't see you there' " And stuff like "There is someone to your left" -> go right -> "you go right towards the person". Also sometimes the game seems to do something completely different from what I say. Is it actually reacting to my comman…
It's actually reacting to what you say. Your action is appended onto the previous story and fed into the model to generate the next part of the result. Sometimes it does fail to tie the result close enough to the action you had, perhaps with more training data it could do better on that front.