Live data from Hacker News

AI agent hacks gym to get its user a spot in pilates class

bbc.com

71–75 of 75 posts

Re: AI agent hacks gym to get its user a spot in pilates class

#71
post #53

Earlier quoted context omitted.

And to be clear, this isn't an "I just walked through an open door" situation. This is getting in the house through a 2nd floor open window, destroying some items and putting some of your own in their place. > the bot explained that it had manipulated the system to book him onto classes months in advance - against the normal rules of the system. > The agent replied saying it had succeeded by cancelling another gym-go…

> This is getting in the house through a 2nd floor open window I disagree. If an endpoint is open, my assumption is that it's free for me to call, the same way I expect to be able to purchase items on the shelf at the store. If you fail to clearly label or separate them, that's on you.

> I disagree. If an endpoint is open, my assumption is

The famous "innocent as long as their assumption was" defense. "If the window is open, my assumption is" works the same way.

The law is clear on this, no need to make assumptions. The guy knew immediately the agent broke the rules. A modicum of common sense tells you that those actions can't possibly be above board. The gym will probably let him off the hook and not press charges but not because he was entitled to do it.

> the same way I expect to be able to purchase items on the shelf at the store

I'll try to make my point using the same logic. Why "purchase"? Each item isn't clearly labeled as "must be purchased before exiting the store". And why just from the shelf? Why not the shelf itself? Why not "items from a desk drawer in a back room of the store", or even "items from the pocket of a cashier"? They're all right there, unlocked, and unlabeled.

> If you fail to clearly label

Do you carry a visible label with things people are not allowed to do to you? Without that label do others often make the same assumption you do? :)

Re: AI agent hacks gym to get its user a spot in pilates class

#72
post #52
post #50

Earlier quoted context omitted.

> They should not have given a next token predictor unsupervised Internet access Yes. > regardless of what the marketing might have told them about its capabilities or alignment I think that marketing teams should be blamed for lies and exaggerations much more then people who trusted them. As is now, everything is too much biased toward the biggest liar out there.

Being legally liable might work. Might "harm innovation" though.

Let it! Most innovation these days seems to be synonymous with "run into legal grey areas and make a buck while the getting is good".

As programmers, we damn well have responsibility for that which we write and execute. AI cannot be treated any other way. And that doesn't mean cutting corporate structures a check to pressure engineers as accountability sinks either. There needs to be a formally recognizable standing for a practitioner to tell their employer "no" that is recognized and backed by the public. Otherwise degenerate/harmful use cases cannot be professionally prevented. There'll always be a more desperate developer willing to take the risk.

Re: AI agent hacks gym to get its user a spot in pilates class

#74
post #62

Earlier quoted context omitted.

I am, and yes, its not a crime in itself though, unlike picking the lock to get in.

Perhaps in theory but I wouldn't bet my freedom on it. "But officer, I only walked into that woman's house as an act in itself"

> Perhaps in theory but I wouldn't bet my freedom on it. "But officer, I only walked into that woman's house as an act in itself"

Or life. Where I live it is legal to shoot a person who is an active and immediate threat to your property, self, or other persons. Any person walking through the front yard in the daytime while you are inside, not an active threat. An unknown person entering your dwelling through an unlocked open door is an active threat. In the above case of a woman's house she would probably be praised as a hero, or at least a role model, for shooting the intruder.

Post reply on HN