Earlier quoted context omitted.
It seems like the hardest part isn't world model -> prose (still hard tbc), but prose -> world model. There have been games for a long time that let you interact with a world model via simple verb + object statements (e.g. "get key", "search chest"), but the power of GPT3-style AI dungeons isn't just that it handles longer, more natural text input, it's that there are no restrictions on the (short-term, incoherent) w…
There's a really interesting cross-over here with literary structure. You need to teach a model to recognize tone, theme, and setting in addition to world "facts." What makes a world like Westeros different than the Shire isn't just facts like "seasons are really long" but elements of tension, political unrest, and the outlook of the people who inhabit it. To do this effectively, you need to be building simulations o…
Choose-Your-Own-Adventure AI Dungeon Games
11–20 of 25 posts
Re: Choose-Your-Own-Adventure AI Dungeon Games
#12Earlier quoted context omitted.
There's a really interesting cross-over here with literary structure. You need to teach a model to recognize tone, theme, and setting in addition to world "facts." What makes a world like Westeros different than the Shire isn't just facts like "seasons are really long" but elements of tension, political unrest, and the outlook of the people who inhabit it. To do this effectively, you need to be building simulations o…
I think in the context of natural language for game worlds, "prose" is targeting the much lower bar of something that sounds like a human might write it, vs like "you PLACED KEY in THE LEFT DOOR. Proceed to A STAIRCASE" from games of yore. Understanding the much richer space of literary prose, such as the difference between the Shire and Westeros, seems like a harder problem, but also one that might be well suited fo…
https://en.wikipedia.org/wiki/SHRDLU
Unless you feel you need flowery expressive input as well as output. But do we really need input more sophisticated than that of Zork here?
Re: Choose-Your-Own-Adventure AI Dungeon Games
#13here's the first 5 minutes of my adventure:
Pick a setting... Apocalyptic
Select a character... Courier
You are Chris, a courier trying to survive in a post apocalyptic world by scavenging among the ruins of what is left. You have a parcel of letters and a small pistol. It's a long and dangerous road from Boston to Charleston, but you're one of the only people who knows the roads well enough to get your parcel of letters there. You set out in the morning and hope to have it in your hands by the time the sun goes down, or else you know you'll never get it there.
You walk down the road and realize that you must be close to the highway. You hold the parcel of letters in your hands and read them.
Dear Chris, It's time for you to get to Charleston. The old man was insistent on this, so you'll be making the trip. You search for a vehicle.
You walk onto the highway and look for a vehicle for yourself. After a time, you see one in the distance, a small hatchback. You check if the small hatchback is operational.
You walk over to the small hatchback and look inside. It looks like it has never been used, and the interior is very clean. You open the door and climb inside. You use the relative position of the rising sun to orient yourself and drive south.
You turn the key and start the small car. It sounds like a lawn mower and comes to life with a burst of smoke. It purrs to life and you back out of the crowded parking lot. You continue driving south.
You drive down the road, glancing at the fuel gauge as you go. It seems to indicate half a tank, which seems unlikely, but you cannot be sure. You continue driving south and look for fuel.
You continue driving south and look for fuel at every station. You come up empty at each one. It is a long and boring drive, and you find yourself staring at the ceiling of the car more and more often. courier Created: Jan 3rd 2022 at 4:20PM Updated: Jan 3rd 2022 at 4:26PM Actions: 14 0 You are Chris, a courier trying to survive in a post apocalyptic world by scavenging among the ruins of what is left. You have a parcel of letters and a small pistol. It's a long and dangerous road from Boston to Charleston, but you're one of the only people who knows the roads well enough to get your parcel of letters there. You set out in the morning and hope to have it in your hands by the time the sun goes down, or else you know you'll never get it there.
You walk down the road and realize that you must be close to the highway.
> You hold the parcel of letters in your hands and read them.
Dear Chris, It's time for you to get to Charleston. The old man was insistent on this, so you'll be making the trip.
> You search for a vehicle.
You walk onto the highway and look for a vehicle for yourself. After a time, you see one in the distance, a small hatchback.
> You check if the small hatchback is operational.
You walk over to the small hatchback and look inside. It looks like it has never been used, and the interior is very clean. You open the door and climb inside.
> You use the relative position of the rising sun to orient yourself and drive south.
You turn the key and start the small car. It sounds like a lawn mower and comes to life with a burst of smoke. It purrs to life and you back out of the crowded parking lot.
> You continue driving south.
You drive down the road, glancing at the fuel gauge as you go. It seems to indicate half a tank, which seems unlikely, but you cannot be sure.
> You continue driving south and look for fuel.
You continue driving south and look for fuel at every station. You come up empty at each one. It is a long and boring drive, and you find yourself staring at the ceiling of the car more and more often. View Adventure Ai Dungeon Logo
Re: Choose-Your-Own-Adventure AI Dungeon Games
#14GPT-3 won't be able to generate a good CYOA until it can generate a good non-interactive novel. Today, GPT-3 can generate text, so you could try to use it to generate a whole novel. People have, but the novels it generates aren't worth reading.
"CYOAs" are interactive novels. I run a company, Choice of Games, that publishes hand-written interactive novels. Our novels use hidden state to provide an experience that's longer, richer, and deeper than traditional paper-based CYOA books. (The author of TFA links to one of our blog posts in the footer of this article. https://www.choiceofgames.com/2011/07/by-the-numbers-how-to-... )
Our approach is to pay professional authors to write these interactive novels. (And we have professional editors who read and edit their work.)
Could we use GPT-3 to avoid paying professional authors? No, of course not. Writing an interactive novel with interesting, dramatic choices is harder than writing a non-interactive novel, and GPT-3 can't even do that.
The feature that makes AI Dungeon interesting and unique is its ability to improvise in response to player's actions. Presenting a pre-computed menu of options is what hand-written interactive novels already do; to succeed, it would have to compete with hand-written interactive novels on quality.
In other words, when GPT-3 computes an entire novel, it's indistinguishable to the reader from a (bad) hand-written novel. If AI Dungeon were to auto-generate an interactive novel, particularly in the way Gwern describes here, with the choices already pre-computed and crowdsourced in advance, the result would be indistinguishable from a (bad) hand-written interactive novel.
I think it's possible that if some future generation of GPT could generate a good-enough novel, then it could also generate a good-enough interactive novel, but this thing has gotta learn how to crawl before it can learn how to walk.
Re: Choose-Your-Own-Adventure AI Dungeon Games
#15You would have to retrain the model to incorporate a global context if you wanted to get a coherent adventure / DMing experience out of it. Once the text tokens (256-2048 depending on the model I believe) go out of scope, they are no longer used for future responses. There's no reason you couldn't build a model around an encoding of a coherent world and then let the GPT part assemble the prose other than actually tra…
I think people are in agreement with this conceptually, and the challenge is figuring out how to effectively implement it. I'd certainly love to see a hybrid like this with a coherent world model, but for example, how do you avoid the existing challenges with procedural worlds where you're basically limited to combinatorial combinations of a small number of primitive features? If the free-form text can't affect more…
Especially if the traditional world sim is fairly rich itself (not like, as rich as the most rich that had been made before, but still decent), and the way the GPT part connects to it is good enough.
Re: Choose-Your-Own-Adventure AI Dungeon Games
#16In this article, Gwern proposes replacing AI Dungeon's free-text parser with a menu of CYOA options. I don't think it will work, at least not with the current generation GPT-3. GPT-3 won't be able to generate a good CYOA until it can generate a good non-interactive novel. Today, GPT-3 can generate text, so you could try to use it to generate a whole novel. People have, but the novels it generates aren't worth reading…
Re: Choose-Your-Own-Adventure AI Dungeon Games
#17In this article, Gwern proposes replacing AI Dungeon's free-text parser with a menu of CYOA options. I don't think it will work, at least not with the current generation GPT-3. GPT-3 won't be able to generate a good CYOA until it can generate a good non-interactive novel. Today, GPT-3 can generate text, so you could try to use it to generate a whole novel. People have, but the novels it generates aren't worth reading…
While AID's nominal attraction is the ability to react to anything, I think based on the evidence only a small percentage of the users end up using it that way. (It's possible they're all the long term users, in which case they are important, but I still think it's a small proportion of the users.) The vast majority of the users the vast majority of the time will be selecting from a small handful of options that would constitute the vast majority of responses.
To the extent you'd find the resulting CYOA rather unappealing, I'd say the current AID is pretty much unappealing in exactly the same way, for exactly the same reasons, and given that AID hasn't exactly taken the world by storm I imagine this is the majority view. (Though it may have the sort of inner core rabid fanbase that you can still build on as a business.)
Re: Choose-Your-Own-Adventure AI Dungeon Games
#18For me, on mobile, they open (I assume) inside an iframe or such, which is counter to how standard links work. This made it really frustrating for me to use. The content seems interesting overall, but I gave up due to how links work. Ridiculous, I know.
Re: Choose-Your-Own-Adventure AI Dungeon Games
#19It could make a good landing page though - play for 10 steps and then spring the "subscribe to continue your adventure".
Re: Choose-Your-Own-Adventure AI Dungeon Games
#20I'm wondering how everyone else felt browsing this website, and using links in particular? For me, on mobile, they open (I assume) inside an iframe or such, which is counter to how standard links work. This made it really frustrating for me to use. The content seems interesting overall, but I gave up due to how links work. Ridiculous, I know.