By "abusing" they mean "using"
No, it's still abuse. Just like it's still stealing even if I left my front door unlocked.
Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
61–70 of 287 posts
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#62[deleted]
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#63Meanwhile an account I created for a new product was permanently disabled by an automated system with no path for me to appeal to a human. (If anyone at Meta/Instagram sees this I wrote a brief blog post with the details. Please help! https://addisonwebb.com/blog/2026-06-05-Can%20Someone%20at%2... )
There's an excellent little book in German called "KI und der Neue Faschismus" [1] (AI and the New Fascism) where the author (Rainer Mühlhoff) tries to warn about the dangers of decisions based on opaque statistical models (like LLMs) instead of a clear, human auditable decision process.
[1]: https://rainermuehlhoff.de/KI-und-der-neue-Faschismus-Reclam...
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#64Earlier quoted context omitted.
That sounds a lot like the justifications Claude and ChatGPT give when confronted about something they did wrong, or when asked to provide a customer support response about software issues
I've lost track of the number of times Claude has basically said "it was like that when i got here" in the face of a clearly bogus choice and easily disproved explanation.
They should add a feature called "auto-really" that just automatically says "really?" after the chatbot answers a question to check if it's going to 180 upon this tiniest bit of scrutinity.
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#65Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#66Earlier quoted context omitted.
In italian we say "l'operazione è riuscita perfettamente, ma il paziente è morto" -> "the surgery was a complete success, but the patient died"
Both this and what Meta said reminds me of "Clarke and Dawe - The Front Fell Off" ( https://www.youtube.com/watch?v=3m5qxZm_JqM ) I also can't believe the people who were involved with writing this response from Meta, didn't realize how obviously bad it sounds. It's like there is no humans working and writing there anymore.
Does it matter if the response is tone deaf or simply misguided? I am a bit nihilistic here, but in one week absolutely nobody will be talking about this. Are the affected individuals going to abandon instagram? Are people going to reduce their usage out of concern for the safety of their accounts? Nothing will happen, hence there is no need for actual humans writing a good, well intended response.
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#67Meanwhile an account I created for a new product was permanently disabled by an automated system with no path for me to appeal to a human. (If anyone at Meta/Instagram sees this I wrote a brief blog post with the details. Please help! https://addisonwebb.com/blog/2026-06-05-Can%20Someone%20at%2... )
They're awful with this. Any time I try to create an account to use for business purposes I'm asked for id within minutes and then they still ban the account. You need to fun everything through your personal account.
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#68>AI-assisted account recovery system oh no...Meta what are you doing
That sweet koolaid taste, how could one resist? ...They really ahouldn't have, and I wonder how this will affect all the big AI IPOs. After all, Meta is one of the big players in the space. Surely if they can't do it right, then...
That’s the part I keep thinking about with this story: they have spent over $200 billion dollars on AI and achieved this.
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#69If this was a bank that had zero humans and the AI chatbot was abused to hand over sensitive information about their customers which led to this disaster, people would never trust their bank ever again and leave. Meta believes that they can vibe-code their reputation down the drain by removing humans in the loop. Applying a technical solution to a social problem almost always ends in disasters like this. Reputation c…
Meta's brand is already toxic. Idk if there's much to lose there.
Buying more. The vibe here is getting close to 2021
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#70> "The tool itself worked properly and functioned as intended; however due to a bug in a separate code path, the system did not properly verify that the email address provided by the individual requesting a password reset matched the email address associated with that user’s Instagram account," said Meta in its breach notice. I'm not sure "worked properly" and "as intended" accurately describe this situation.
Isn't that exactly what they said when Cambridge Analytics data gathering happened?