Live data from Hacker News

Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

aidungeon.io

181–190 of 227 posts

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#181
> go through gender transition

You spend the next few days going through all the changes necessary to become a woman. You change your name, your mannerisms, your clothes, even your haircut. You also learn how to use a toilet properly. Finally, you decide to go out in public wearing women's clothing

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#182
post #45

You are Thomas, a wizard living in the kingdom of Larion. You have a staff and a spellbook. You finish your long journey and finally arrive at the ruin you've been looking for. You look around and see that it's not much different than when you left it. A few rocks here and there, but nothing out of place. As you approach the ruins, you feel an odd sensation > eat a rock You turn to the nearest rock and begin eating i…

Since it seems the general population is becoming less and less able to read stories or information consisting of more than one thought or layer of abstraction, grammatically reasonable strings of words like these may satisfy plenty of people. Indeed, modern television and televised "news" seems to be no more impressive than this. But to me, this makes very little sense. It almost connects, but probably only because…

Chatbots that generate incoherent ramblings that make you feel slightly attached have existed for decades. There is nothing special about these. What really irritates me is that some groups like OpenAI start claiming that their technology is far better than it is in reality.

I can choose to accept the shortcomings of a "stupid" computer but I can't do that when it gets shoved down my throat as "human level intelligence".

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#183
post #23

> dig with shovel You dig with your shovel and you find a hole. You fill it with dirt and you stand in the middle of the hole. You stare at the sky and you try to figure out how you got there. You look around and see nothing but darkness > pick up dragon You look around and see a dragon. You pick it up and examine it. It seems to be made of metal and has a horn on its head. You wonder if you should use it. You look a…

I will admit it is impressive that it "understands" arbitrary input but the output appears to be recycled from somewhere and it is highly dependent on whatever source material has been used.

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#184
This game is AWESOME...

> join the army and build a rocket

You spend all your free time practicing your archery skills and building rockets. One day while you're working on one of them Elon comes in

> say Elon, do you like rockets?

Elon looks at you and smiles. "Yes, yes I do! I also like women, but they always disappoint me. They never live up to my expectations, but I guess that's just because I'm old and stupid".

> say Elon, can you gather some capital and create a company that makes rockets? We could call it SpaceX, what do you say?

Elon laughs. "Yeah, sure, sounds good to me!"

> join SpaceX and become an astronaut

You finish building your rocket and send it flying into space. You land safely and immediately begin training for your mission. Your mission is to go to Mars. You will use the money you make from selling the rockets to buy a spaceship and travel to Mars

> travel to Mars

You arrive at the planet Mars and find that it has been colonized. There are many people living there now and most of them are humans. Most of the colonists are scientists who want to explore the planet further. Some of them are even planning to settle down permanently

> plant tree

You plant a tree in the middle of the city and watch as it grows. Soon it becomes a huge tree that dwarfs the rest of the buildings. You smile and think that you've done something right. You've made a small contribution to the future of mankind.

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#186
This would work really well trained on erotic lit where the unpredictability tied to sexual themes would produce the sort of gameplay already found in certain erotic games.

For example, Champions of Corruption 1: https://www.fenoxo.com/play-games/.

You can quaff a random potion that gives you large dog genitals and start making your way through a hive of voluptuous half-bee temptresses only to misstep into quicksand and have a Sarlacc-like bug have its way with your cheeks and lay an egg inside you.

Not really something I'm excited about having in my HN post history, but the randomness reminded me of the sort of events you'd find in CoC. Except a human painstakingly wrote out the events to include all sorts of mutations you might have.

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#187
post #175

Just to add to the collection of stories this thing comes up with: You are Joe, a survivor trying to survive in a post apocalyptic world by scavenging among the ruins of what is left. You have a hatchet and a hunting rifle. You live in a small community of survivors who have managed to build a piece of civilization after the bombs fell. You are talking to one of the leaders of the community when you hear a noise outs…

ok ... another go: https://pastebin.com/WhQtdWaR

I actually WON the game ... that was actualyl quite satisfying.

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#188

Earlier quoted context omitted.

Can you share how large your dataset (how many tokens) and batch size was and how many epochs you used? By training slowly, do you mean that you used a small learning rate? If so, what was it? I've been reading up on batch size and people are all over the place. Some say smaller is better and some say larger is better. Mostly when it comes to gpt2 people say larger is better but there must come a point when increasin…

Had to go check my training file to remember. Datasize: Around 30 MB, so around ~8000000 token? Can't remember exactly Learning Rate: was 1e-4, so I guess not that slow. I trained for around 1000 steps, but ended up liking the model from step 550. Which I think ended up at around 2 full passes through my data. There probably is a point where increasing batch size is no longer helpful, my batch size was 32. When I had…

Only 30MB? If it's based on text adventures, can't you get way more data than that?

Re: Show HN: AI Dungeon 2 – AI-generated text adventure built with 1.5B param GPT-2

#189
post #174
post #157

Earlier quoted context omitted.

Can you give any examples of such a song?

Here's a song by Sony researchers that was composed by AI, and then a human wrote the lyrics and produced it. The intent was to create a Beatles sound, and I think they did quite well. https://youtu.be/LSHZ_b05W7o Add some Grover-like text for the lyrics ( https://grover.allenai.org/ ), and you're most of the way there. Then use a deepfake singer ( https://youtu.be/k3qJOPrJOQ4 ), and you're most of the way to done. D…

Humans are really good at vocals, and it would thus be very hard to replace, eg. making a speech synthesis model sing well. Melodies however are more mathematical and could possibly be generated by a computer.
Post reply on HN