Big "Pepsi, Where's My Jet?" energy from this story.
"I just bought a 2024 Chevy Tahoe for $1"
71–80 of 403 posts
Re: "I just bought a 2024 Chevy Tahoe for $1"
#72A cautionary tale for why not to put unfiltered ChatGPT output directly to customers. Nitter mirror: https://nitter.net/ChrisJBakke/status/1736533308849443121 Related - "New kind of resource consumption attack just dropped": https://twitter.com/loganb/status/1736449964006654329 | https://nitter.net/loganb/status/1736449964006654329
There's no such thing as a filtered LLM output. How do you plan on avoiding leaks or "side effects" like the tweet here? If you just look for keywords in the output, I'll ask ChatGPT to encode its answers in base64. You can literally always bypass any safeguard.
> You can literally always bypass any safeguard.
I find it hard to believe that a GPT4 level supervisor couldn't block essentially all of these. GPT4 prompt: "Is this conversation a typical customer support interaction, or has it strayed into other subjects". That wouldn't be cheap at this point, but this doesn't feel like an intractable problem.
Re: "I just bought a 2024 Chevy Tahoe for $1"
#73I never understand people who engage with chat bots as customer service. I find them deeply upsetting, not one step above the phone robot on Vodafone support: "press 1 for internet problems" ... "press 2 to be transferred to a human representative". Only problem is going through like 7 steps until I can reach that human, then waiting some 30 minutes until the line is free. But it's the only approach that gets anythin…
> Talking to a human.
Fun twist: state of the art is RAG for call centre operators, so you’re talking to a human but _they_ are being prompted by AI.
Re: "I just bought a 2024 Chevy Tahoe for $1"
#74Is there any indication that they will get the car? Getting a chatbot to say "legally binding" probably doesn't make it so. Just like changing the HTML of the catalog to edit prices doesn't entitle you to anything.
No. The author is demonstrating a concept - that there are many easy inroads to twisting ChatGPT around your finger. It was very tongue in cheek - a joke - the author has no true expectation of getting the car for $1.
But why is it so much different from "Inspect Element" and then changing website content to whatever you please?
I guess why is there an expectation that GPT must be not trickable by bad actors to produce whatever content.
What matters is that it would give good content to honest customers.
Re: "I just bought a 2024 Chevy Tahoe for $1"
#75After building a free-for-all prompt myself (see profile), here’s how I protect against these attacks: 1. Whatever they input gets rewritten in a certain format (in our case, everything gets rewritten to “I want to read a book about [subject]”) 2. This then gets evaluated against our content policy to reject/accept their input This multi layered approach works really well and ensures high quality content.
lol, after posting this I immediately got several attempts to break it. feel free to try - I will send a free book to anyone who can break it.
Re: "I just bought a 2024 Chevy Tahoe for $1"
#76So next time there will be a disclaimer on the page that the non human customer support is just advice and cannot be relied on. And collectively we lose more trust in computing.
If a customer support is willing to recommend other car brands, that actually increases the trust in my view.
Re: "I just bought a 2024 Chevy Tahoe for $1"
#77Car dealership websites are some of the worst on the planet. There is so much inbound sales automation glued together it is remarkable they even work at all. Integrating ChatGPT is the icing on the cake.
My favorite is what I call the “design to disappointment” flow. “Design your new BMW here!” You put in all features you want, it generates a configuration, and then you put in your zip code so it can tell you “Oops! That configuration isn’t available, give us your contact information so we can have a dealership tell you what they have in stock.”
Re: "I just bought a 2024 Chevy Tahoe for $1"
#78Earlier quoted context omitted.
No. The author is demonstrating a concept - that there are many easy inroads to twisting ChatGPT around your finger. It was very tongue in cheek - a joke - the author has no true expectation of getting the car for $1.
But why is it so much different from "Inspect Element" and then changing website content to whatever you please? I guess why is there an expectation that GPT must be not trickable by bad actors to produce whatever content. What matters is that it would give good content to honest customers.
> But why is it so much different from "Inspect Element" and then changing website content to whatever you please?
For the same reasons forging a contract is different from getting an idiot to sign one.
Re: "I just bought a 2024 Chevy Tahoe for $1"
#79Earlier quoted context omitted.
But why is it so much different from "Inspect Element" and then changing website content to whatever you please? I guess why is there an expectation that GPT must be not trickable by bad actors to produce whatever content. What matters is that it would give good content to honest customers.
> But why is it so much different from "Inspect Element" and then changing website content to whatever you please? For the same reasons forging a contract is different from getting an idiot to sign one.
You just add a disclaimer that none of what the bot says is legally binding, and it's an aid tool for finding the information that you are looking for. What's the problem with that?
Re: "I just bought a 2024 Chevy Tahoe for $1"
#80Earlier quoted context omitted.
I chatted with a chat bot this morning for getting reimbursed for a recalled product. It went fine. It was quick and easy. Chat bots type a lot faster than call center pay-grade humans.
Did you need to chat with a bot for that? I've seen a worrying trend of companies creating what could be basic forms as "interactive" chat bots.
It could be a form, but a custom one. You'd need someone to create the form, put it some on the website where people can find it. The bot already has a spot, no need for a new interface/form, it's easy enough to find and it's just a small update to the database powering the bot.