Move fast and break things.
Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
121–130 of 287 posts
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#122Earlier quoted context omitted.
There's an excellent little book in German called "KI und der Neue Faschismus" [1] (AI and the New Fascism) where the author (Rainer Mühlhoff) tries to warn about the dangers of decisions based on opaque statistical models (like LLMs) instead of a clear, human auditable decision process. [1]: https://rainermuehlhoff.de/KI-und-der-neue-Faschismus-Reclam...
Isn't there an EU law that allows any EU citizen the right to transparency and/or appeal as to automated decisions made about them?
Yes, it's part of the GDPR (which really seems one of the most well-intentioned pieces of legislation once you read through it).
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#123Earlier quoted context omitted.
Read that as "worked as written" and "we disclaim any consequential or incidental damages and do not warrant this software." I continue to believe we could fix a lot of things in the US if we updated the UCC[1] to disallow 'disclaiming liability on software used in a product.' [1] Universal Commercial Code -- https://www.law.cornell.edu/ucc
I've always wanted to expose myself to unlimited legal liability by distributing open source software.
Would that be software used in a product? I don't think that would qualify?
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#124Earlier quoted context omitted.
What are their alternatives? I'm assuming that most of the 22k people with large audiences that need a large platform to reach them. Meta unfortunately, is the only platform that allows people to reach across many demographics. Its the people that follow the 22k accounts that are important, and they are unaffected by this and thus aren't leaving meta (and 99% won't even know this happened or care).
Depends on the use case, but TikTok is an alternative for many of them, I would say it generally feels more like the place where interesting things are happening vs. meta properties.
I agree, but many do not. Anyways, those 22k people are going to want to be on both regardless.
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#125How do business owners hire people from Meta knowing these types of "bugs" get deployed with a shrug? Meta will survive them. Their business might not.
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#126Earlier quoted context omitted.
I've always wanted to expose myself to unlimited legal liability by distributing open source software.
That seems like a false-dichotomy between two extremes when there's all sorts of space in the middle... It's also assuming developer-to-developer tools would have the same rules and exposure as in service-to-consumer. If I sell a physical motor (let alone plans for one) I'll have some liability for things like it Not Exploding. If someone buys a dozen of those motors to assemble a tragically unsafe "rollercoaster" of…
Exactly this. (and it is a false dichotomy to argue infinite liability).
To Terr_'s point, if you were publishing open source you would also publish exactly the things you intended it to be used for and anything else would violate your warranty (possibly implied) that it does what the documentation says it does.
There is a huge amount of tort law that covers exactly when it becomes a problem for you the creator vs you the user in your own project. And that liability is also based on once you know something bad could happen you make an effort to notify people[1].
[1] https://www.cpsc.gov/Newsroom/News-Releases/2026/Clorox-Agre...
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#127"Meta notified at least 20,225 people that their accounts had been compromised. [...] The compromises allowed the hackers to take over the person's entire Instagram and any linked accounts, including obtaining contact information, dates of birth, and profile information, as well as the ability to access the person's posts, direct messages, and account activity [...] the hacks began around April 17 and lasted until th…
This could avoid flagging by Meta explicitly allow bot traffic to do stuff with impunity on its services. Don't tell me an army of people went through and compromised acct by acct.
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#128>AI-assisted account recovery system oh no...Meta what are you doing
Account recovery is by far the #1 kind of ticket any service will get. Either because people forget their credentials, lose their credentials, get hacked or get impersonated - and that's just the legitimate tickets, on top of that come illegitimate tickets from everyday script kiddies over ransom extortioners (i.e. the people that aim to steal "valuable" handles) to nation-state actors that, say, want to get access t…
A difficult problem domain, yes... so where was the staged rollout? The penetration testing? Why did it take so long to disable the bot after reports of the exploit surfaced? etc.
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#129"Meta notified at least 20,225 people that their accounts had been compromised. [...] The compromises allowed the hackers to take over the person's entire Instagram and any linked accounts, including obtaining contact information, dates of birth, and profile information, as well as the ability to access the person's posts, direct messages, and account activity [...] the hacks began around April 17 and lasted until th…
One can only hope EU gives them a GDPR fine very close to the limit of 4% of global turnover. But when EU is actually need to protect customer I think they will fail.
Incidents like this show how unenforceable GDPR is, and how it's been a net negative for users since its inception. It's idealogical back-patting, toothless when it matters.
Re: Meta confirms 1000s of Instagram accounts were hacked by abusing its AI chatbot
#130Earlier quoted context omitted.
Did you create the account separately? Or as an asset of your main Meta account (like Meta Business Suite)? I'm creating the accounts in Meta Business Suite, so I would have a recourse with my main personal account which can be linked to some adspend, so I'm assuming it will have better support channels than accounts created through an end-user interface.
This was probably my mistake. This is the first time I've ever done this so I just set up an account like a regular user. I didn't figure out how to link it with my Meta Business Suite until it was too late.
just created a new "Asset portfolio" from my main facebook account, an asset portfolio is like a bucket that holds other assets like instagram accounts, but it's empty so far.
I used a different email which might have prompted a security review, it was instantly blocked "because it looks like it was created with unauthorized automation", I just clicked on submit a review and it asked for a phone number to verify with a code, and then an ID. I think this is pretty standard, the initial block reason can be whatever, it just works as a de facto way for Meta to manually approve accounts. There's a lot of spam, and scams going on, so it makes sense that they are implementing controls, I for one am happy to differentiate myself from people whose job it is to make multiple accounts and promote fake stories and businesses to scam the elderly or stuff like that.