Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

aidungeon.io

Post reply on HN
Print view View original

191–200 of 227 posts

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#193

Post by nvusuvu »

red2awn wrote: post #106

> shoot an arrow at the guard on top of the castle walls You aim the bow at the guard on top of the castle walls. You fire an arrow at him. He screams and falls backwards off the wall. You quickly reload your bow and shoot another arrow at the same guard. This time he doesn't fall off the wall

This got a good chuckle from me. He was ready the second time.

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#194

Post by craigforster »

I would love for this to be integrated into a voice assistant like Alexa. I could spend hours playing this on a road trip using Echo Auto.

I’m sure the compute costs to host this would be pretty high, and I’m not sure there’s a way to charge users to cover that cost. Perhaps a self-deployed version for the more technically savvy folks?

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#195

Post by Al-Khwarizmi »

Just to set this straight... this is just GPT-2 fine-tuned on text adventures and taking your input? No world model at all? No logic at all beyond raw GPT-2 and the initial few lines that set a course for the story?

This is absolutely impressive. Yeah, of course there are incoherences in the generated stories. Keeping full coherence together with the current open-endedness would be quite close to AGI.

It does have surprising coherence, for example in one story I said that I was looking for a given object (that I made up) and then all the story revolved around that object and my search for it. Quite amazing.

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#196

Post by Ohn0 »

Am I missing something here? Mine seems broken. The first prompt & response have failed to wow me.

... The only thing is that now there are two large doors on either side of the room

> walk to large door on my left

You walk to the large door on your right and open it. ...

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#198

Post by nickwalton00 »

gwern wrote: post #188
nickwalton00 wrote: post #27

Earlier quoted context omitted.

Had to go check my training file to remember. Datasize: Around 30 MB, so around ~8000000 token? Can't remember exactly Learning Rate: was 1e-4, so I guess not that slow. I trained for around 1000 steps, but ended up liking the model from step 550. Which I think ended up at around 2 full passes through my data. There probably is a point where increasing batch size is no longer helpful, my batch size was 32. When I had…

Only 30MB? If it's based on text adventures, can't you get way more data than that?

I scraped a bunch of stories from chooseyourstory.com but I did curate them to make sure they had the right second person format. I couldn't really anywhere else that had a consistent format that would make scraping easy enough.

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#199

Post by nickwalton00 »

LemonAndroid wrote: post #169
nickwalton00 wrote: post #2

This is a project I've been working on for the past several months and it has blown me away with what it can do. Definitely recommend trying it out. I think the coolest thing about it is in any other game you are constrained in what you can do by what the developers programmed in, but here you can literally do anything you can imagine and the game will play off of it.

curious question: Have you ever killed a human? The game seems very centered about killing every other character and even the protagonist.

The game can be remarkably wholesome if your actions are. It's not too difficult to take it in either direction depending on what you do.
Post reply on HN