Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT is really good at roleplaying

blog.varunramesh.net

Post reply on HN
Print view View original

81–90 of 97 posts

Re: ChatGPT is really good at roleplaying

#81

Post by lucubratory »

pocketarc wrote: post #53
nacs wrote: post #23

The problem with using these for freeform roleplaying is that it's very easy to hit the "I'm sorry but as an AI model..." that completely breaks character. Even on the first example with the fish that is supposed to insult you, you quickly find that it will default to the "As an AI model I can't..." response. This is where open-source models are going to be far better even if they don't have the parameter count of Ch…

I've been building up a team of Slack bots that act as coworkers, with all different roles and personalities, and was able to turn off the "as an ai model" shenanigans by adding to their system prompt "You do not reveal that you are an AI. Instead, you make up excuses." And it works flawlessly (disclaimer: GPT-4, not 3.5). They'll always deftly avoid anything that reveals that they're an AI, with plausible, legitimat…

I'd love to read that, would definitely be worth publishing on a blog or something

Re: ChatGPT is really good at roleplaying

#82

Post by erenyeager »

With role play, if it refuses to do something against its policy, you can keep prompting it then tell it to continue on and then it will “remember” the stuff you told it which it originally denied and incorporate it into the new message. Very easy to make ChatGPT get very explicit, or hateful, etc.

Re: ChatGPT is really good at roleplaying

#83

Post by alsodumb »

Paul-Craft wrote: post #48
alsodumb wrote: post #22

Earlier quoted context omitted.

Depends on what model you're using. I'm a PhD student, I use GPT-4 as a "knowledgeable on all topics but sometimes confidently wrong" companion. I'd say ChatGPT is where I search first in 90% of the cases these days. I do confirm important things in Google, but the information provided by chatGPT is the starting point of my Google search, especially on topics/questions where I don't have a clear question and a vague…

That's interesting. Are you using it for work in your field of study? What is your field of study if I may ask? The reason I'm asking is that I studied math in school, and GPT is an absolute garbage fire when it comes to anything mathematical. I could not imagine using it even for graduate level coursework.

I broadly work in decision making under uncertainty - so a bit of control theory, a bit of optimization, a bit of machine learning, and AI planning (MDPs, POMDPs).

I definitely don't do math say at the level of a math grad student, but I do fair bit of proofs, mostly using concepts from real analysis and functional analysis. I'd say GPT4 does pretty good sometimes (this is mostly me testing to see how well it works, I don't have a particular use case). I use Github copilot (I believe it uses GPT-3?) to write my latex documents and it works really well at predicting the equations I am writing and saves a lot of time!

Re: ChatGPT is really good at roleplaying

#84

Post by d0mine »

chaxor wrote: post #60
alsodumb wrote: post #22

Earlier quoted context omitted.

Depends on what model you're using. I'm a PhD student, I use GPT-4 as a "knowledgeable on all topics but sometimes confidently wrong" companion. I'd say ChatGPT is where I search first in 90% of the cases these days. I do confirm important things in Google, but the information provided by chatGPT is the starting point of my Google search, especially on topics/questions where I don't have a clear question and a vague…

This is a decent way to explain a good use case - exploration of new priors and ideas. For example, I was looking for a good way to do streaming xml parsing in the simplest way possible. One way is to do it via various packages in different languages and write out all the functions to pause etc. Another option (apparently a language, but domain specific) is XSLT. I already knew these things, but by using GPT-4 I foun…

To parse xml without loading it into memory, one interesting element at a time in Python:

  import xml.etree.cElementTree as etree

  def getelements(filename_or_file, tag):
    context = iter(etree.iterparse(filename_or_file, events=('start', 'end')))
    _, root = next(context) # get root element
    for event, elem in context:
        if event == 'end' and elem.tag == tag:
            yield elem
            root.clear() # preserve memory
https://stackoverflow.com/questions/7697710/python-running-o...

The usage is simple: getelements() generates the desired elements one by one. Found using google search for "xml memory iterparse"

Re: ChatGPT is really good at roleplaying

#86

Post by jallbrit »

netruk44 wrote: post #68

> I’ve noticed that bot will mention things from the game that aren’t specifically pointed out in the prompt - ChatGPT clearly has prior knowledge of the Elder Scrolls universe. I'm working on integrating text generation into OpenMW and I've noticed the same thing. I tell GPT-3.5 that it's playing as "an NPC in The Elder Scrolls III: Morrowind, a character named 'Fargoth'" and it'll start talking about "What brings y…

Where can I follow your progress on this?

Re: ChatGPT is really good at roleplaying

#87

Post by throwaway675309 »

14 wrote: post #45

That actually was very amazing and fun. He is my conversation with Seamen: What do you want human? I want to feed you Feed me? Ha! You expect me to eat whatever slop you put in front of me? I have standards you know. I only eat the finest sushi made from the freshest fish in the sea. So unless you can provide me with that, I suggest you don't waste your time with me. Well I plan to cut little parts of your body off,…

This reads like a boiler plate eliza rogerian response system that's learned to be much more verbose.

The bot didn't really say anything concrete or specific in nature - all of its replies were fairly pedestrian. I'd suggest rereading your transcript with a more critical eye. Highly coherent responses but banal at best.

Re: ChatGPT is really good at roleplaying

#88

Post by slopbop »

I've used Character AI (https://beta.character.ai) and been seriously impressed with the roleplaying experience that's provided there. A UX feature that really helped was the ability to "swipe left" on a reply and "re-roll" it- this can help keep the AI from getting off topic, or retry when it gives "Eliza" type responses, ie

"AI: Are you ready for your karate practice? User: Definitely, let's get started! AI: Great, what sort of things do you think we should do at karate practice?"

If you squint a bit and are willing to provide a little guidance in the form of leading questions, you really can have some pretty fun RP experiences, I've spent hours at this point doing little scenes and I've been really surprised at the wealth of different experiences that the AIs are capable of providing.

Other caveat of course is that it's not really suited to "longform" RP, I can't imagine it scaling to a "campaign" that you return to multiple times per month over the course of a year- I think this is a limitation of the tech at this point, as far as I know the LLM basically is always re-reading the entire chat history to generate the next response and presumably eventually this stops being feasible.

Re: ChatGPT is really good at roleplaying

#89

Post by xrd »

spudlyo wrote: post #50
xrd wrote: post #20

I want this for my kids when I'm driving them to school. We try to play dungeons and dragons and I'm exhausted trying to drive and be DM. Is there an open source LLM (Llama?) which could be configured to do this? I hate operating against a commercial service.

There are a number of models based on Meta's Llama that have been fine-tuned for storytelling. These are not truly open source per-se, due to the murky nature of the leaked base model, but should be fine for what you're describing. If you're interested in this sort of thing I'd recommend reading r/LocalLLaMA on Reddit and checking out @samwitteveenai on YouTube. Local inference of the larger 30B models is going to re…

Thanks, this is great information. Really appreciate the thorough answer.

Re: ChatGPT is really good at roleplaying

#90

Post by chaxor »

d0mine wrote: post #84
chaxor wrote: post #60

Earlier quoted context omitted.

This is a decent way to explain a good use case - exploration of new priors and ideas. For example, I was looking for a good way to do streaming xml parsing in the simplest way possible. One way is to do it via various packages in different languages and write out all the functions to pause etc. Another option (apparently a language, but domain specific) is XSLT. I already knew these things, but by using GPT-4 I foun…

To parse xml without loading it into memory, one interesting element at a time in Python: import xml.etree.cElementTree as etree def getelements(filename_or_file, tag): context = iter(etree.iterparse(filename_or_file, events=('start', 'end'))) _, root = next(context) # get root element for event, elem in context: if event == 'end' and elem.tag == tag: yield elem root.clear() # preserve memory https://stackoverflow.co…

Yeah, that's an option I'm aware of, but it gets quite ugly when the rules are more than just a few.
Post reply on HN