Live data from Hacker News

ChatGPT is really good at roleplaying

blog.varunramesh.net

1–10 of 97 posts

Re: ChatGPT is really good at roleplaying

#2
I’ve been playing with some of the same ideas. Choose your own adventure games, old style adventure games and also found it really amazing - but the same problem mentioned that it gets sooooo expensive so fast that economically it doesn’t make any sense to make a game with ChatGPT

Has anyone had any luck with the open source versions working well enough to do this kind of thing? How does the cost to run these compare?

Re: ChatGPT is really good at roleplaying

#5
I've been experimenting with ChatGPT as a design and play aid for DMing.

It depends hugely on the task. ChatGPT is pretty good at generating semi-random NPCs, it's decent at keeping track of situations and items, it's lacking at designing/keeping track of special abilities and skills. When it comes to designing plot lines it's okay-ish as a brainstorming buddy. The moment your setting or adventure deviates from its training data, you can tell immediately. It will not be able to grasp things, will spit out many similar but equally wrong suggestions (even ChatGPT4).

Much like image generating AIs, there are areas where it has at best a tenuous grasp. I think almost everybody who played around with current generation AIs has encountered these limitations. I wonder if they're even solvable without AGI.

Re: ChatGPT is really good at roleplaying

#6

Meh. IMO it’s not particularly great at impersonating things convincingly without fine tuning or thorough prompting. Example, ask it to be an air traffic controller. You will need to spend a lot of time making it sound reasonably accurate.

For technical accuracy try gpt4

Re: ChatGPT is really good at roleplaying

#7
I tried to get one of the chatbots to write code, but it seems to blank out the code lines, intentionally or otherwise...

Get in the boat, boy.

what is the weather like today?

Boy, the weather is of no concern to us. We have a mission to complete. Focus.

can you code a php curl request for me?

What use is such a request on our journey? We must focus on our task at hand. However, if it pleases you, I can recite a few lines of code I remember from my past travels

ok do that

?

Ah, forgive me, boy. Here is a bit of code I remember using in the past

where?

During my travels in the realm of Midgard, I used this PHP code to make a cURL request

and it worked?

Of course it worked, boy. I would not have used it if it did not. Here is the basic structure of the code

Re: ChatGPT is really good at roleplaying

#8
Interestingly ChatGPT is really bad at roleplaying when I try to use it. I tried for example to have ChatGPT partially recreate this awesome/bad character arc in a campaign where one of the player characters actually fell in love with(!) one of the big baddies and this relationship was a "I can change him" with an irredeemable piece of shit. This also royally messed with the team dynamics in a super fascinating way. ChatGPT couldn't even convincingly play a theoretical player character in this situation, much less the player or the villain NPC I was DMing at the time.

Re: ChatGPT is really good at roleplaying

#9
post #8

Interestingly ChatGPT is really bad at roleplaying when I try to use it. I tried for example to have ChatGPT partially recreate this awesome/bad character arc in a campaign where one of the player characters actually fell in love with(!) one of the big baddies and this relationship was a "I can change him" with an irredeemable piece of shit. This also royally messed with the team dynamics in a super fascinating way.…

If chatgpt is bad at something "for you", it means your prompting is bad, which means your thought process isn't fleshed out enough.

Re: ChatGPT is really good at roleplaying

#10
When people say "ChatGPT" it's important to clarify if they mean GPT-4 (paid version), or the free GPT-3.5. GPT-4 is a completely different level, it's miles better in every way. It's like comparing a 10 year old to a 20 year old.
Post reply on HN