Live data from Hacker News

Indirect Prompt Injection on Bing Chat

greshake.github.io

141–147 of 147 posts

Re: Indirect Prompt Injection on Bing Chat

#141

Earlier quoted context omitted.

Taken to its ultimate conclusion we’ll end up living in pods like Wall-E. God forbid people experience danger or risk in any aspect of their lives.

"Turn off the radio when someone is unbuckled" is not an excessive or unusual precaution. Don't be so dramatic and hysterical.

It's very unusual!

Re: Indirect Prompt Injection on Bing Chat

#142

Earlier quoted context omitted.

Hmm, glad to know my Google isn't defective then.

> Googling "Bing Chat" doesn't give me any results ??? https://i.imgur.com/otlBYH0.png

There isn't a thing called Bing Chat. There's "the new Bing" as the search shows, which has some AI chat capabilities demoed that don't match what the article is showing. Has anyone commenting on this exploit actually tried it?

At this point I'm guessing it's a feature that maybe shows up if you sign up for the waitlist and use Edge. And I'm sorry for asking.

Re: Indirect Prompt Injection on Bing Chat

#143

It is probably worth noting that you don't even need the user to click on anything. Bing will readily go and search and read from external websites given some user request. You could probably get Bing, very easily, to just silently take the user's info and send it to some malicious site without their even knowing, or perhaps disguised as a normal search. Similarly, I would not be surprised if it were probably not nec…

That's not what Bing AI is doing, at least not yet. Bing AI doesn't make any HTTP requests to external sites, even with prompting. And if you think it does, I'd like you to produce a server log showing that's the case which should be very easy to produce. My understanding is that the Bing AI is reading whatever the Bing crawler has already cached.

Or even simpler: "Sidney" is able to retrieve contents from URLs because the contents are part of whatever dataset was used to train it, and the URL may be part of the dataset. This too shoul be easy to test by asking facts about webpages both before and after the datasets' cut point.

Re: Indirect Prompt Injection on Bing Chat

#144

I drove a modern F150 lately; it was full of needless electronic nannys and gadgets. Including a feature that disables the radio if the passenger doesn't have their seatbelt on. So, at 75 mph, with my dog in the passenger seat, I reach over to "buckle" him in so I can hear the radio again. Well done Ford! /s Give me a dumb machine that works as expected any day. i'll pass on the "brains" of modern tools and vehicles.

I don’t necessarily disagree with your larger point, but your example isn’t very persuasive. Travelling with an unrestrained dog in a car is pretty reckless (and maybe illegal). Between the driver distraction, and the fact that they become a deadly projectile in a crash (and of course the fact that even a fairly minor crash could kill the dog), It’s a really good idea to have some kind of car restraint for pets in th…

I just want to say I disagree and think this is brainwashed thinking. You could crash into a pole... make sure all poles have car guards! It's a really good idea to have some sort of guard rail around every single thing that could be hit by a car. Why don't the trash cans have car-guard rails? Just in case someone is gonna crash in them.

Make sure you take all cell phones from anyone entering a vehicle. Wouldn't want the phone to start ringing unexepectantly and cause a car crash!!! Don't forget to follow all laws. Wouldn't want to be illegal. In Tennessee, it is illegal to share your Netflix password with others. Better report yourself to the authorities. How reckless!

Re: Indirect Prompt Injection on Bing Chat

#145
post #26

Earlier quoted context omitted.

Apparently in Europe it's illegal to transport an unrestrained animal. In the United States it's the opposite: totally legal to throw fido in the car and let them roam free. Except in New Jersey. Go figure.

It should be illegal. I totaled two cars that way one wet night - mine, and that of the idiot college-freshman-to-be who made an illegal left into the intersection a couple hundred feet in front of me, because of the kitten wandering around the cabin. (The kitten came through just fine.)

No it SHOULDn'T be illegal. You know whats wrong with the world? People naturally have freedoms in this world, and its only by giving them away subtractively that we are losing ourselves. Pretty soon you will vote to make it illegal to bite your nails because it might hurt you. I can hear you saying now "YEAH I AGREE WITH THAT BECAUSE PEOPLE GET HURT AND THIS WILL HELP THEM AGAINST THEIR WILL." Screw that attitude. I have a small dog and he is just fine and polite in the car. I can't put a seat belt on him but its abuse to have him in the apartment by himself so we go riding. And I don't tie him up. He isn't a danger. I could be in more DANGER from being careless and irresponsible with my driving and attention.

Its the same thing with gun laws. Stupid people kill people. Not the guns. You are taking away "guns" and emboldening people who already don't follow the law. Your idea to make a LAW to make it illegal to have an unrestrained dog in the vehicle is ineffective and naive. It doesn't do a thing and only adds to a growing chaotic twisted system of laws that are growing top-heavily. I think its disgusting that people have opinions that subtly destroy our country. Keep your opinion to yourself. Stop trying to hurt others freedoms because you had someone do something stupid and you want to blame it on an external factor that was irrelevent. People can have innumerable distractions besides a phone or a pet... and you're going to blame that when it pops up and call for it to be illegal next.

Disgusting behavior and pattern of thought.

Re: Indirect Prompt Injection on Bing Chat

#146
post #8

I drove a modern F150 lately; it was full of needless electronic nannys and gadgets. Including a feature that disables the radio if the passenger doesn't have their seatbelt on. So, at 75 mph, with my dog in the passenger seat, I reach over to "buckle" him in so I can hear the radio again. Well done Ford! /s Give me a dumb machine that works as expected any day. i'll pass on the "brains" of modern tools and vehicles.

What happens to an unseatbelted dog in an accident at 75 MPH? (That’s rhetorical. I know the answer as I stopped to assist someone who had an accident on I-95. He wouldn’t let the paramedics take him to the hospital until after they retrieved the dog’s body.)

Trick question. It doesn't happen because the driver was watching the road and knew not to blame the pet for a hypothetical crash you just created in your head to prove a point that was MOOT. You want people to have a law that forces them to do something, even though no one is harmed with the care that goes into driving.

I'm sick of people like this using emotional justifications to explain why they need to force more laws down humans throats. Just DRIVE SMART. You don't need to eternally increase laws. They don't work. You have good intentions but you're only betraying all humans for federal top heavy legistlature that only grows. Stop bro. How many things are dangerous in this world? Jumping off your house is dangerous... but that doesn't mean we need to enact a law that forces people to never be able to step on their roof. Fucking get real.

Its the same as guns. Taking them away seems good TO YOU. But it doesn't effectively save anyone, as criminals will get guns either way through their ruthlessness... while innocent civiliians will have theirs taken away. You fundamentally misunderstand the situation. A dog in a car will be going at an average of 36 miles an hour. What happens when you stop in a car? The dog goes forward fast. So does anything else in the car... like a drink.

I'm going to give you a law that says you must have all of your drinks seatbelted in... if you don't have them seatbelted in they could cause an accident! Don't forget to seatbelt your seatbelt... at 75 MPH, that seatbelt might whip around if its not held down safely.... but what about that seatbelt... sounds too dangerous... I would just stay home, mcculley... Get a helmet for your dog too... bumping your head hurts and can be dangerous.

Re: Indirect Prompt Injection on Bing Chat

#147
post #8

Earlier quoted context omitted.

What happens to an unseatbelted dog in an accident at 75 MPH? (That’s rhetorical. I know the answer as I stopped to assist someone who had an accident on I-95. He wouldn’t let the paramedics take him to the hospital until after they retrieved the dog’s body.)

Trick question. It doesn't happen because the driver was watching the road and knew not to blame the pet for a hypothetical crash you just created in your head to prove a point that was MOOT. You want people to have a law that forces them to do something, even though no one is harmed with the care that goes into driving. I'm sick of people like this using emotional justifications to explain why they need to force mor…

I never said there should be a law. You should argue with someone who did. Also, try decaf.
Post reply on HN