Live data from Hacker News

AI Model Detects Mental Disorders Based on Web Posts

home.dartmouth.edu

21–30 of 74 posts

Re: AI Model Detects Mental Disorders Based on Web Posts

#21

Earlier quoted context omitted.

Precisely. The cyber stalking of applicants is about to get even worse. Anyone having a public presence on social media is hurting themselves.

And anyone without one is then nobody.

Someone needs to build a bot that posts boring, but socially acceptable content that won’t raise any red flags for potential employers.

Re: AI Model Detects Mental Disorders Based on Web Posts

#22

I'd say very little good can come from this. What would be an example of an "appropriate" use of this technology? Basically where it could excel is giving probabilistic prediction of "mental disorders" across a high volume of users. What is a good thing you would do with that? Advertising to suggest someone to get help, maybe?

I worked on a shared task (CLPsych [1]) that estimates mental distress severity. So the classification task was to determine how acutely a user message/post on a mental health forum would require moderator intervention. Some people announce their suicides live on the forum for instance. You want to point the moderators to those people asap.

Our research group applied this tech to Belgium's suicide prevention center chat tool, so the workers can prioritize based on severity.

1. https://aclanthology.org/W16-0312/

Re: AI Model Detects Mental Disorders Based on Web Posts

#23
post #3

Witty. But those claims must feel a bit insulting to people who actually study mental disorders, chemical imbalances etc.

"chemical imbalances", is that a thing?

Thyroid issues often correlate with mental health issues.

Re: AI Model Detects Mental Disorders Based on Web Posts

#24

I'd say very little good can come from this. What would be an example of an "appropriate" use of this technology? Basically where it could excel is giving probabilistic prediction of "mental disorders" across a high volume of users. What is a good thing you would do with that? Advertising to suggest someone to get help, maybe?

> What would be an example of an "appropriate" use of this technology?

Applying it to the statements of dictators so you know when to replace them?

Re: AI Model Detects Mental Disorders Based on Web Posts

#26
> Reddit, which offers a massive network of user forums, was their platform of choice because it has nearly half a billion active users who discuss a wide range of topics.

Let’s be honest here… Reddit was their first choice because of the high prevalence of mental disorders amongst its users. One wonders why they didn’t choose Twitter instead in that case… but better to test the AI system’s load capacity before tackling such a gargantuan task I suppose.

Re: AI Model Detects Mental Disorders Based on Web Posts

#27
post #26

> Reddit, which offers a massive network of user forums, was their platform of choice because it has nearly half a billion active users who discuss a wide range of topics. Let’s be honest here… Reddit was their first choice because of the high prevalence of mental disorders amongst its users. One wonders why they didn’t choose Twitter instead in that case… but better to test the AI system’s load capacity before tackl…

> One wonders why they didn’t choose Twitter instead in that case

I don't know, but I doubt it's that Reddit users are substantially less mentally healthy than Twitter users. There might be a mean intelligence difference (just guessing), but Twitter isn't exactly known for rational and sane communication of ideas.

Although might Reddit simply have a larger corpus per user given the lack of a character limit?

EDIT: The more I think about it, the more I think my assumption is close to the truth. Even if your character limit is 280 characters, that limit can affect how someone forms their sentences. If there is no meaningful limit then a person can feel they can express their full idiolect unencumbered.

Re: AI Model Detects Mental Disorders Based on Web Posts

#28
post #24

I'd say very little good can come from this. What would be an example of an "appropriate" use of this technology? Basically where it could excel is giving probabilistic prediction of "mental disorders" across a high volume of users. What is a good thing you would do with that? Advertising to suggest someone to get help, maybe?

> What would be an example of an "appropriate" use of this technology? Applying it to the statements of dictators so you know when to replace them?

Euphemisms anyone?

Re: AI Model Detects Mental Disorders Based on Web Posts

#29

I'd say very little good can come from this. What would be an example of an "appropriate" use of this technology? Basically where it could excel is giving probabilistic prediction of "mental disorders" across a high volume of users. What is a good thing you would do with that? Advertising to suggest someone to get help, maybe?

Youre right that getting rates of mental disorders at the population level is a useful application. Checkout for example the hedonometer: https://hedonometer.org/timeseries/en_all/?from=2021-12-05&t... . People have also done population-level research showing that bad weather affect various seniment-based metrics of mental health: https://journals.plos.org/plosone/article?id=10.1371/journal...

This doesn't work as a reasonable objective measure of population mental health disorders for several reasons.

1) The oversampling of the training set makes it uncalibrated when applied to the general population (to recalibrate you need an estimate of the prevalence to begin with, which sort of defeats the purpose).

2) Online posts are not a random sample of the population. (Perhaps this is solveable with some poststratification of the estimates, although requires demographic data on the poster.) If you take self reports that the researchers used to define disorders at face value, those would make more sense than using this model.

These text based models are so superficial, when applied to mass datasets with low prevalence of the underlying condition, they will ultimately result in very low positive predictive values (e.g. flag 100 people, if the model is good will only get 5/100 as actual mental health problems).

As version_five asks, it is hard to imagine any reasonable use of the model given such low positive predictive values (which imply incredibly high false positive rates).

Post reply on HN