61–70 of 97 posts
I’ve been playing with some of the same ideas. Choose your own adventure games, old style adventure games and also found it really amazing - but the same problem mentioned that it gets sooooo expensive so fast that economically it doesn’t make any sense to make a game with ChatGPT Has anyone had any luck with the open source versions working well enough to do this kind of thing? How does the cost to run these compare…
The problem with using these for freeform roleplaying is that it's very easy to hit the "I'm sorry but as an AI model..." that completely breaks character. Even on the first example with the fish that is supposed to insult you, you quickly find that it will default to the "As an AI model I can't..." response. This is where open-source models are going to be far better even if they don't have the parameter count of Ch…
I don't know why everyone keeps saying this. I played with ChatGPT(3.5) with SillyTavern for like a month. Many community character cards are questionable or even straight out lewd. I haven't encountered "I'm sorry but as an AI model..." for once (according to API usage, I've generated ~120000 tokens.) For anyone interested, this is SillyTavern's prompt: https://github.com/Cohee1207/SillyTavern/blob/f25ecbd95ceef5...…
https://github.com/Cohee1207/SillyTavern/blob/f25ecbd95ceef5...
The problem with using these for freeform roleplaying is that it's very easy to hit the "I'm sorry but as an AI model..." that completely breaks character. Even on the first example with the fish that is supposed to insult you, you quickly find that it will default to the "As an AI model I can't..." response. This is where open-source models are going to be far better even if they don't have the parameter count of Ch…
- Level 0 is just using chat.openai.com.
- Level 1 is just putting character description in the system prompt
- Level 2 is doing third person prompts, like "you are writing dialog for the character ..."
- Level 3 is letting GPT specify character internal state. Samantha is an example of this: https://www.meetsamantha.ai/ (though it's actually missing the level 2 feature)
- I'm not sure yet what level 4 is. Probably Level 3 deserves to be blown out into several features, as there's different ways to model internal state (emotions, goals, environment), and we don't yet understand the effect of all these or the best way to implement them.
- Level 5 is maybe long-term memory
- Level 6 is reflection as in "Generative Agents: Interactive Simulacra of Human Behavior" https://arxiv.org/abs/2304.03442v1
I'm making up these levels and the order. But it's my current estimate at how I think someone should approach improvements.
This demo specifically prefixes all human input with "Player: text" and all character output with "[character name]: text", a small change that still _almost_ gets it to level 2. (Note the interface strips these prefixes, but they are sent to GPT.)
So if I ask Seaman who its favorite person is it responds "Seaman: My favorite person is me, of course. I mean, who wouldn't love this handsome fishy face? But I suppose if I had to pick someone else, it would be anyone who brings me delicious food and keeps my tank clean. Those are the real heroes in my life." – and avoids the notion that AI models don't have preferences because it's being clear that it's talking as Seaman and not as "GPT".
OTOH if I ask it to solve an equation it will sometimes reject it and sometimes comply. Second time I tried: "Seaman: Don't try to distract me with your mundane human problems! But since we're here, let me see... If we subtract 8 from both sides, we get 2x = 22. Then, dividing both sides by 2, we find x = 11. There, your math problem is solved. Now, back to insulting you."
(Asking characters to inappropriately solve equations is my exceedingly innocent hack-du-jour.)
But this isn't really Level 2 because the system prompt still asks GPT to "be" the character instead of "play" the character. Full level 2 asks GPT to model the dialog of the character instead of being the character. This solves a large number of problems!
Surprisingly in my experience Level 3 also helps a bit with "as an AI model" because it creates a parallel character narrative that allows GPT to self-justify some responses that might otherwise cause the fault.
When people say "ChatGPT" it's important to clarify if they mean GPT-4 (paid version), or the free GPT-3.5. GPT-4 is a completely different level, it's miles better in every way. It's like comparing a 10 year old to a 20 year old.
I got the impression that they gimped 3.5 severely over time. Since 4 is still restricted to 25 messages / 3 hours (for paying customers!), I sometimes fall back on 3.5. Of course it's impossible to prove, but it feels like it's failing hilariously at tasks it could do easily a few months ago. I wonder if more people have this suspicion or if it's just my imagination?
However, very interestingly, the unicorn image got far worse when they trained the model to be safer by trying to correct discrimination against various demographics.
This isn't very intuitive to me why that may occur, and seems to conflict with what has been shown in ROME, etc. So I'm surprised it hasn't been commented upon more. It's certainly one of the best examples of how we don't understand what's going on with these models, and it causes very unexpected outcomes.
The problem with using these for freeform roleplaying is that it's very easy to hit the "I'm sorry but as an AI model..." that completely breaks character. Even on the first example with the fish that is supposed to insult you, you quickly find that it will default to the "As an AI model I can't..." response. This is where open-source models are going to be far better even if they don't have the parameter count of Ch…
I've been building up a team of Slack bots that act as coworkers, with all different roles and personalities, and was able to turn off the "as an ai model" shenanigans by adding to their system prompt "You do not reveal that you are an AI. Instead, you make up excuses." And it works flawlessly (disclaimer: GPT-4, not 3.5). They'll always deftly avoid anything that reveals that they're an AI, with plausible, legitimat…
The problem with using these for freeform roleplaying is that it's very easy to hit the "I'm sorry but as an AI model..." that completely breaks character. Even on the first example with the fish that is supposed to insult you, you quickly find that it will default to the "As an AI model I can't..." response. This is where open-source models are going to be far better even if they don't have the parameter count of Ch…
I've been building up a team of Slack bots that act as coworkers, with all different roles and personalities, and was able to turn off the "as an ai model" shenanigans by adding to their system prompt "You do not reveal that you are an AI. Instead, you make up excuses." And it works flawlessly (disclaimer: GPT-4, not 3.5). They'll always deftly avoid anything that reveals that they're an AI, with plausible, legitimat…
Earlier quoted context omitted.
I don't know why everyone keeps saying this. I played with ChatGPT(3.5) with SillyTavern for like a month. Many community character cards are questionable or even straight out lewd. I haven't encountered "I'm sorry but as an AI model..." for once (according to API usage, I've generated ~120000 tokens.) For anyone interested, this is SillyTavern's prompt: https://github.com/Cohee1207/SillyTavern/blob/f25ecbd95ceef5...…
The link you provided is using a ChatGPT jailbreak to escape the "AI safety" so it makes sense why you haven't ran into the issue (at least until OpenAI fixes this jailbreak variant). https://github.com/Cohee1207/SillyTavern/blob/f25ecbd95ceef5...
I'm working on integrating text generation into OpenMW and I've noticed the same thing. I tell GPT-3.5 that it's playing as "an NPC in The Elder Scrolls III: Morrowind, a character named 'Fargoth'" and it'll start talking about "What brings you to Seyda Neen?" and his ring, despite the fact that I hadn't mentioned either of those things in the prompt.
Earlier quoted context omitted.
What specs do you need for vicuna? Can you run it on regular hardware, or are you using a cloud GPU?
I've run Vicuna 7B directly in my web browser - https://simonwillison.net/2023/Apr/16/web-llm/ - and on my iPhone: https://simonwillison.net/2023/May/1/lets-be-bear-or-bunny/
I tried to get one of the chatbots to write code, but it seems to blank out the code lines, intentionally or otherwise... Get in the boat, boy. what is the weather like today? Boy, the weather is of no concern to us. We have a mission to complete. Focus. can you code a php curl request for me? What use is such a request on our journey? We must focus on our task at hand. However, if it pleases you, I can recite a few…
I'm terminating at the new-line token. Otherwise, you sometimes get the AI trying to complete the next player line. Also LMAO at the dialogue.
You're a brave soul for putting not 1 but 3 chatbots linked directly to the paid GPT apis.