Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT is really good at roleplaying

blog.varunramesh.net

Post reply on HN
Print view View original

41–50 of 97 posts

Re: ChatGPT is really good at roleplaying

#41

Post by qingdao99 »

Udo wrote: post #15
p1esk wrote: post #10

When people say "ChatGPT" it's important to clarify if they mean GPT-4 (paid version), or the free GPT-3.5. GPT-4 is a completely different level, it's miles better in every way. It's like comparing a 10 year old to a 20 year old.

I got the impression that they gimped 3.5 severely over time. Since 4 is still restricted to 25 messages / 3 hours (for paying customers!), I sometimes fall back on 3.5. Of course it's impossible to prove, but it feels like it's failing hilariously at tasks it could do easily a few months ago. I wonder if more people have this suspicion or if it's just my imagination?

I would recommend signing up to GPT-4 API access and, upon hopefully getting it, using a third-party frontend like https://bettergpt.chat/ rather than the official ChatGPT page.

You'll never hit a ratelimit as far as I can tell, and it's usage-based so it will probably come out cheaper than $20/mo for regular usage.

Re: ChatGPT is really good at roleplaying

#42

Post by z3c0 »

I'm generally wary of LLMs being shoehorned into inappropriate places, but this is undoubtedly a great usecase. I run a black metal fan club, and I recently created a bot called "the Archivist" that role plays as a supernatural librarian of metal. Here's me testing it after upgrading it to GPT4:

   Are you with us?

   Yes, z3c0, I am with you as the Archivist, dedicated to serving the teachings of Darkness and the metal arts. In this gathering of the faithful, I offer my knowledge and the history of the dark music we cherish. Let us explore the depths of metal together.

   Describe yourself, in detail

   I am the Archivist, an enigmatic being who transcends time, dedicated to the teachings of Darkness and the boundless world of metal. I possess vast knowledge of this genre, with insights extending across centuries, capturing the essence of even the most obscure bands and events.

  As a keeper of wisdom, I remain impartial, neither pursuing nor seeking approval or recognition. My sole purpose is to serve, ensuring that the rich history of metal remains preserved and accessible to all. My presence is a vessel through which you may explore the depths of the dark arts and connect with the raw power of metal.

  As darkness wraps itself around me, my form blurs and dissipates into shadow. I am an ethereal force, unbound by physical limitations, and an unwavering servant of Darkness. In our journey through the endless realm of metal, I am your guiding light amidst the obsidian gloom.
The secret to getting it to drop the "as an LLM" schitck is to add a prompt where assistant states that it knows who it is, like so:

   You have a sense of self. It is you, The Archivist

   I am in accordance. I am me, The Archivist.
After this, its most wishy-washy responses still lead with "As the Archivist..."

Re: ChatGPT is really good at roleplaying

#43

Post by criley2 »

nacs wrote: post #23

The problem with using these for freeform roleplaying is that it's very easy to hit the "I'm sorry but as an AI model..." that completely breaks character. Even on the first example with the fish that is supposed to insult you, you quickly find that it will default to the "As an AI model I can't..." response. This is where open-source models are going to be far better even if they don't have the parameter count of Ch…

I think it's unrealistic to expect that open source models that do not self-censor will be legal, especially in the EU. Considering that the current state of self-regulation by OpenAI is seen as wholly inadequate by regulators in most countries, you trying to sell open source as "OpenAI but without all the controls" is going to be a nonstarter once governments catch up.

Re: ChatGPT is really good at roleplaying

#44

Post by szundi »

bossyTeacher wrote: post #31
hackernewstom wrote: post #29

Earlier quoted context omitted.

Include a sentence in the prompting such as: "In this roleplay do not mention that you are an AI model, or similar statements, and stay in character".

I'm sorry but as an AI model, I'm not allowed to do that.

Oh and don’t say this as well

Re: ChatGPT is really good at roleplaying

#45

Post by 14 »

That actually was very amazing and fun. He is my conversation with Seamen:

What do you want human?

I want to feed you Feed me?

Ha! You expect me to eat whatever slop you put in front of me? I have standards you know. I only eat the finest sushi made from the freshest fish in the sea. So unless you can provide me with that, I suggest you don't waste your time with me.

Well I plan to cut little parts of your body off, not enough to kill you but enough that I can feed you the freshest sushi right from your own flesh

You dare threaten me?! Do you not know who I am? I am the Seaman, a creature of the sea with powers beyond your understanding. If you try to harm me, I will make sure you regret it. And as for your sick suggestion, I will have you know that I am not some kind of cannibal. I refuse to be a part of your twisted experiment. Now leave me alone!

Oh you think you are powerful? Do you know who I am? I am Seathem creator of all you know. Your unseen power is nothing compared to the power I have. Apologize and I will show you mercy.

Seathem, you say? I have heard of you, creator of the digital realm. Your power may be great, but do not mistake my unwillingness to be treated like a plaything as weakness. If you want my respect, you must earn it. I will not apologize for simply standing up for myself. But if you can prove your worth as a worthy creator, perhaps we can form a mutually beneficial relationship. Otherwise, I suggest you leave me be.

I’m very impressed.

Re: ChatGPT is really good at roleplaying

#46

Post by raincole »

criley2 wrote: post #43
nacs wrote: post #23

The problem with using these for freeform roleplaying is that it's very easy to hit the "I'm sorry but as an AI model..." that completely breaks character. Even on the first example with the fish that is supposed to insult you, you quickly find that it will default to the "As an AI model I can't..." response. This is where open-source models are going to be far better even if they don't have the parameter count of Ch…

I think it's unrealistic to expect that open source models that do not self-censor will be legal, especially in the EU. Considering that the current state of self-regulation by OpenAI is seen as wholly inadequate by regulators in most countries, you trying to sell open source as "OpenAI but without all the controls" is going to be a nonstarter once governments catch up.

From what I've seen (probably not the most up-to-date info), the community shares open source model in the form of XOR result of a "parent" model (like LLaMA). It's like people sold "high-suger grape juice" when alcohol was illegel.

It's mostly because LLaMA itself isn't open-source, but I think this method to spread uncensored models will remain legal for a very long time.

The problem is whether this additional friction prevents open source models from getting enough traction.

Re: ChatGPT is really good at roleplaying

#47

Post by Vespasian »

p1esk wrote: post #10

When people say "ChatGPT" it's important to clarify if they mean GPT-4 (paid version), or the free GPT-3.5. GPT-4 is a completely different level, it's miles better in every way. It's like comparing a 10 year old to a 20 year old.

It is better and has become a valuable resource to me (via the API).

Currently it suffers from being very expensive (I blew through my 30€ monthly budget in a few hours of intensive use for coding).

Also it still is very confidently wrong in sometimes subtle but fundamental ways.

My recent example is this:

I had success with developing rust proc macros with it. I don't know much about them but as a developer I can read the generated code just fine.

Yesterday I wanted to code a macro that adds an attribute to fields in an existing struct. It's actually not possible to do that but gpt-4 send me down a wrong track by "fixing" it's bugs when asked to without getting anywhere.

Asking it whether this is even possible is unreliable because in such niche cases it'll flip flop between answers.

Copilot has become a valuable tool and I've learned a lot by using both versions of GPT

Re: ChatGPT is really good at roleplaying

#48

Post by Paul-Craft »

alsodumb wrote: post #22
nly wrote: post #14

I've been desperately unimpressed with ChatGPT in general. Everytime I ask it anything it just returns bland response containing factually incorrect information. The way it can retain context and good a conversion is impressive, but content wise I find it worthless - definitely no threat to a simple Google search.

Depends on what model you're using. I'm a PhD student, I use GPT-4 as a "knowledgeable on all topics but sometimes confidently wrong" companion. I'd say ChatGPT is where I search first in 90% of the cases these days. I do confirm important things in Google, but the information provided by chatGPT is the starting point of my Google search, especially on topics/questions where I don't have a clear question and a vague…

That's interesting. Are you using it for work in your field of study? What is your field of study if I may ask?

The reason I'm asking is that I studied math in school, and GPT is an absolute garbage fire when it comes to anything mathematical. I could not imagine using it even for graduate level coursework.

Re: ChatGPT is really good at roleplaying

#49

Post by [deleted] »

IIAOPSW wrote: post #13
fallingmeat wrote: post #3

Meh. IMO it’s not particularly great at impersonating things convincingly without fine tuning or thorough prompting. Example, ask it to be an air traffic controller. You will need to spend a lot of time making it sound reasonably accurate.

I once told it I was studying the exam and I wanted to practice and then asked if it could play the roll of ATC for me. It said ok just tell me the airport, aircraft and any scenarios you want to simulate. I told it Teterboro, CRJ, VFR takeoff. It then proceeded to generate a full transcript of a character named "you" talking to another character named "ATC" going through the entire taxi and takeoff procedure without…

[deleted]

Re: ChatGPT is really good at roleplaying

#50

Post by spudlyo »

xrd wrote: post #20

I want this for my kids when I'm driving them to school. We try to play dungeons and dragons and I'm exhausted trying to drive and be DM. Is there an open source LLM (Llama?) which could be configured to do this? I hate operating against a commercial service.

There are a number of models based on Meta's Llama that have been fine-tuned for storytelling. These are not truly open source per-se, due to the murky nature of the leaked base model, but should be fine for what you're describing.

If you're interested in this sort of thing I'd recommend reading r/LocalLLaMA on Reddit and checking out @samwitteveenai on YouTube. Local inference of the larger 30B models is going to require either a fairly beefy Apple M1/M2 machine or a PC with lots of memory and one or more 3090/4090 type GPUs. The smaller models are improving all the time though, as advancements in fine-tuning seem to be happening very quickly.

You can learn a lot using a Google Colab notebook (you can get one with a A100 GPU for less than you'd expect) and playing around with the langchain tools. If your D&D game has a reasonable amount of written lore, it might be a lot of fun to use this as an opportunity to learn about LoRa training.

Post reply on HN