the internet is smoking your brain.
Facebook deploys AI for early signs of suicide
121–130 of 160 posts
Re: Facebook deploys AI for early signs of suicide
#122beep boop "take your medicine. take your medicine"
Re: Facebook deploys AI for early signs of suicide
#123I so wish people would stop abusing the term AI . This is an application that employs heuristics upon scanned data and then executes events. By that definition half of everything written in JavaScript is AI.
The game industry has already been abusing the term AI beyond all recognition for a long time.
You have a point about how by that definition, half of everything written in JavaScript is AI. Have you taken a look at the source for jQuery? Good grief, it's like an expert system chock full of heuristics for sniffing and manipulating the DOM and handling and dispatching events in so many different incompatible browsers.
And then there's Gnu autoconf...
Re: Facebook deploys AI for early signs of suicide
#124This may or may not be a useful technology, but the fact that Facebook thinks they have the ability and the right to diagnose their users with mental illnesses is disturbing. They have more information about their users than psychologists have about their patients. They can (and do) build a psychological profile and diagnose mental illness. Yet rather than keeping this information in the closest confidence, they sell…
> Facebook thinks they have the ability and the right to diagnose their users with mental illnesses Maybe it's more that Facebook thinks it's horrible when people kill themselves, and that if Facebook's tech could help prevent suicide, inaction would be immoral. Most of us accept some level of State interference in our lives for our own good. Maybe we are going to have to have that discussion about involuntary interv…
[deleted]
Re: Facebook deploys AI for early signs of suicide
#125This may or may not be a useful technology, but the fact that Facebook thinks they have the ability and the right to diagnose their users with mental illnesses is disturbing. They have more information about their users than psychologists have about their patients. They can (and do) build a psychological profile and diagnose mental illness. Yet rather than keeping this information in the closest confidence, they sell…
> Facebook thinks they have the ability and the right to diagnose their users with mental illnesses Maybe it's more that Facebook thinks it's horrible when people kill themselves, and that if Facebook's tech could help prevent suicide, inaction would be immoral. Most of us accept some level of State interference in our lives for our own good. Maybe we are going to have to have that discussion about involuntary interv…
> Maybe it's more that Facebook thinks it's horrible when people kill themselves
Of course! You can’t show ads to dead people...
Re: Facebook deploys AI for early signs of suicide
#126Earlier quoted context omitted.
Interesting.. I wonder if these profiles fall under HIPAA.
Absolutely not. HIPAA regulates the medical and insurance industries, which Facebook is certainly not. If you broadcast medical data to the public or put it in a newspaper HIPAA does not apply, much like this case. Best case scenario, and this is still a stretch, is that Facebook could be guilty of slander if they describe you has suicidal and that description becomes known to a third party without your consent.
Facebook is known to collect key presses. If I express a desire to commit suicide in a status update, but don't actually post it, thus not showing it to anybody except Facebook, would that (should it?) be covered by HIPAA? What if I keep paper diary? What if it's in Google docs instead?
Re: Facebook deploys AI for early signs of suicide
#127Please permit me to play the pessimistic man on the street: If Facebook can deploy AI to detect the early signs of suicide, why can't they deploy AI to detect "fake news" or those susceptible to "fake news"? Furthermore, "cui bono" (for whose benefit [0])? What does Facebook gain from being able perform this sort of detection given it is a for-profit corporation and not a non-profit philanthropic organization? An asi…
I'm not a psychiatrist nor have any expertise or insight into suicidal behavior, but I feel very confident in saying that the detection of a potential suicide is a much easier problem than the detection of fake news.
There's a few reasons for why suicide seems easier to detect, but I'll just give one: it is feasible to conceive of a reliable and reasonably efficient threshold for detecting some suicides. And I can say this even though off-hand, I can't think of anyone close to me that has killed themselves...the closest example might be Aaron Swartz, who I did not know off of the Internet, and whose suicide even to this day stuns me.
And yet I can come up with a few real-life scenarios in which I would feel comfortable in calling 911 about:
- I see someone (a total stranger) standing on the railing of the Golden Gate bridge, facing in the direction they need to face to jump out into the water.
- I see someone, again, doesn't matter if a total stranger or someone I know, holding a gun to their head with their finger to the trigger.
- A friend I haven't heard from for sometime, and am not expecting to hear from in the near future, suddenly calls me to tell me they've swallowed an entire bottle of Tylenol and they wanted to at least talk to me one more time before death.
All these situations, I have no problem calling 911 and screaming at the operator to get help quick.
The first 2 situations aren't easily detectable in the framework of Facebook communication. But the third one, I'm pretty sure have actually happened on Facebook and other social media networks, and people, with and without the help of the social media service, attempted to save the person's life:
- http://www.cnn.com/2009/SHOWBIZ/Movies/04/03/moore.twitter.t...
- https://www.reddit.com/r/AskReddit/comments/3ham0a/serious_t...
- https://www.theguardian.com/technology/2011/jan/05/facebook-...
- https://www.buzzfeed.com/drumoorhouse/my-best-friend-saved-m...
The content of these messeages, and other meta-factors, such as time of day and relationship and frequency of contact between receiver/sender, are signals. The threshold can be set to a level high enough that false positives are relatively rare -- as rare as someone who looks like they're about to jump off the Golden Gate Bridge but turns out to be posing for a photoshoot, or is just being an extreme troll.
The downside is that there may be a lot of false negatives. But as tragic as that is -- some lives saved through automation is better than nothing. And this heuristic could be implemented in an efficient way.
So what's the difference between suicides and fake news? For fake news, it seems impossible to conceive of any kind of threshold that would catch items that are indisputably fake news while having a very low rate of false positives.
The main reason? There is no objective definition of either "fake" or "news", nevermind "fake news", when it comes to items that are purported to be news stories.
Let's ignore the concept of news. Let's consider assertions. How easy would be for Facebook to come up with an algorithm to flag true and false for these examples:
- The earth is flat
- Barack Obama is a Muslim
- The Holocaust is a fabricated historical event.
For the sake of argument, I'll agree that FB's NLP and Knowledgebase-type tech can accurately flag the above assertions -- in fact, Alexa did a pretty good job of answering "Yes" and "No" when I rephrased them as questions.
How about when these assertions are reworded to be a little bit different:
- There are researchers today who believe the Earth is flat and say they have evidence to prove it
- Barack Obama may secretly be a Muslim, according to some pastors
- Did the Holocaust happen?
Assume the above examples are titles to news articles. And if you don't think such phrasing would be used in a mainstream news source, I invite you to visit washingtonpost.com or huffingtonpost.com on any given day.
If you've paid attention to recent controversies about Google SERP, you'll recognize that the third example -- "Did the Holocaust happen?" -- was recently a major problem for Google. And that was for something much simpler -- what sites are most relevant for that query -- than what Facebook has to figure out: "Is this fake news"
Maybe you want to argue that in this situation, Facebook should definitely filter it out as "fake news" because not only does the article contain a lot of implied bullshit, it is simply not a news article. But then you've introduced a whole other problem: how does Facebook determine the difference between a purported news story and an op-ed? Human beings have problems with this when it comes to newspapers and their editorial sections:
https://www.nytimes.com/2015/01/11/public-editor/an-uneasy-m...
https://www.americanpressinstitute.org/publications/good-que...
The ability for Facebook's fake news regulator to tell the difference between opinion and news is critical. Because while we may agree that a news story titled "The Holocaust is a Jewish Conspiracy" should not be treated as truth nor news, it's a whole other can of worms to argue that Facebook should surpress someone wanting to go on a angry opinionated rant, no matter how distasteful their opinion. I'm not a NLP expert, but this seems to me like a pretty hard NLP problem to do with reasonable accuracy and efficiency.
OK, let's make things simple and assume a universe in which the only article wall-post type that Facebook has to deal with are news stories, i.e. no one ever posts opinion pieces/blog rants -- or hell, satire, something that Google News has had trouble with even though Google News uses a whitelist...
One of the other fundamental challenges is that the definition of what is "news" is very hard for humans to objectively quantify. Look at the popularity of Reddit's r/todayilearned, one of Reddit's most popular subreddits even though it consists of posting facts that are years/decades old. And yet, for the vast majority of users, those facts are most definitely news, and news that is enlightening and interesting.
-----
Let's consider some real-life example headlines of purported news stories:
"SHOCKING: How Barack Obama lived with an single white teenage mother without Michelle knowing"
Is this fake news? It is most definitely not fake: Barack Obama was born to an unmarried white 19-year old. And I bet there are plenty of people who might not realize that his mom was so young and was a single mother. Some people might not even realize Barack is half white! So this headline not only contains no falsehoods, but assertions that are news to many readers. And you you could make a strong argument that it should be penalized as "fake news" because the wording of the headline is trying its best to imply a sexual and illicit multiracial affair.
I can't even imagine how difficult it would be to have an algorithm that works with this example, nevermind detects "bad intentions".
How about this one:
- Bill Cosby said to be a serial rapist
Does this seem like an obvious real news story? Tell that to all the journalists -- including the CNN executive who was writing Cosby's biography -- before a shaky YouTube clip of Hannibal Buress calling Cosby a rapist went viral:
http://www.latimes.com/entertainment/tv/showtracker/la-et-st...
Buress's routine was based off of a long-ago news story that never got major play. You can go to the TMZ archives for the Bill Cosby tag and see for yourself that even TMZ had nothing about Cosby's allegations until Buress went viral. And Buress's routine was not even new -- he said he'd been using it for about 6 months before the random YouTube clip got noticed.
Pretend Buress never went viral. In this alternate universe of 2015, the Cosby biography has been published, Cosby is still respected, and yet every once in awhile, your Facebook feed has screaming headlines like "HOW THE MEDIA IGNORES BILL COSBY'S HISTORY OF RAPE". Would you be wrong in wondering why the fuck Facebook hasn't suppressed such outlandish posts? Or pretend you were one of the few people to have read the original expose on Cosby's accusers. You know it's a fact that he has a "history", but it is now nearly 10 years later -- if those accusations had any merit, the media, especially TMV, would be all over Cosby. But that's not the case so you flag the post as "fake news". What is Facebook's algorithm supposed to do here?
Final example of a news story headline: SHOCK CLAIM: KEVIN SPACEY SEXUALLY ASSAULTED ME WHEN I WAS A BOY
This claim is definitely news and of course, we know now that it is unlikely to be fake. But this example illustrates one more core difficulty in telling what is "fake", what is "news" and what is "fake news".
BuzzFeed was the first to report the claim by Anthony Rapp, and it was an exclusive -- meaning no other major news outlet had anything that could confirm it: https://www.buzzfeed.com/adambvary/anthony-rapp-kevin-spacey...
It's easy for Facebook to tell that this is "news". But what signals does it have that it isn't fake, when no other major outlets is reporting it? BuzzFeed's entire story is based off of one person's recollection of a decades-ago incident. In the hours between Buzzfeed's shocking scoop and reports of other allegations that eventually doomed Spacey and House of Cards -- a strong case could be made that FB should be penalizing the Buzzfeed article as "fake" or at least "maybe fake". And a lot of this would hinge on how much you think buzzfeed.com should be treated as reliable.
Re: Facebook deploys AI for early signs of suicide
#128This may or may not be a useful technology, but the fact that Facebook thinks they have the ability and the right to diagnose their users with mental illnesses is disturbing. They have more information about their users than psychologists have about their patients. They can (and do) build a psychological profile and diagnose mental illness. Yet rather than keeping this information in the closest confidence, they sell…
> Facebook thinks they have the ability and the right to diagnose their users with mental illnesses Maybe it's more that Facebook thinks it's horrible when people kill themselves, and that if Facebook's tech could help prevent suicide, inaction would be immoral. Most of us accept some level of State interference in our lives for our own good. Maybe we are going to have to have that discussion about involuntary interv…
> Most of us accept some level of State interference in our lives for our own good.
The state is elected by the people and is - at least nominally - meant to serve them.
> Maybe we are going to have to have that discussion about involuntary interventions by corporations, too.
This is textbook Corporatocracy. I have neither the power to vote corporations in or out nor any recourse if they decide I need an "intervention". How is this not high-tech serfdom?
Re: Facebook deploys AI for early signs of suicide
#129There's a lot of pessimism in the comments. I believe this is one of the best uses for an AI that we've come up with. First, let's go into the details: 1. They only monitor and elevate to moderators content from posts and Facebook live. 2. Moderators can then take action, and reports from this system are prioritized over other non-pressing issues. The actual life saving chances of this system are huge. Just from a pu…
I help to run a suicide/depression support group on FB and I do not at all trust FB as a corporation to do a good job on this. Having had friends who've been involuntarily hospitalized and all that goes with that I'm extremely skeptical that this will turn out well. 'But it might save lives!' is true, but it might also wreck lives by institutionalizing people that thought they were venting their feelings to a trusted…
For those who aren't familiar, this is how it can play out:
1. Friend^H^H^H^H^H Facebook notices you said something that sounds suicidal to them.
2. They call the police.
3. The police show up and take you to an emergency psychiatric facility (you don't have as much choice in the matter as you think you do, and you can't anticipate the consequences).
4. The facility keeps you in their custody until your friends or relatives can convince them to release you. They are financially incentivized to keep you there. You have limited contact with the outside world. You are effectively a prisoner.
5. Once you get out,
a. You get to explain why you didn't show up for N days of work
b. You get a bill in the mail for thousands of dollars
c. The courts will not help you.
Re: Facebook deploys AI for early signs of suicide
#130Earlier quoted context omitted.
I'm worried there's a taboo developing where only professionals or mentally ill people themselves are allowed to express any kind of opinion about mental illness or the mentally ill.
I'm worried that the field of psychology is gaining a monopoly on expression of feelings. We can no longer express happiness and sadness, anxiety and frustration, without being "diagnosed" in a horoscopic manner which has little or nothing to do with science and bears a great deal of stigma. The psychological disorders of today are the occult of yesterday. We believe that one can become possessed by depression or anx…
You are free to reject diagnosis and medication unless you are determined a danger to yourself or others. HIPAA also gives you control over where your diagnoses travel.
Not with facebook, of course, which doesn’t qualify for hipaa protections yet.