Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bumble releases open-source A.I. feature to help combat unsolicited nudes

bumble.com

Post reply on HN
Print view View original

171–180 of 255 posts

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#171

Post by wink »

stevesimmons wrote: post #136
returnzero wrote: post #62

Many years ago (ca. 2009?) at a previous employer we had an enterprise email scanner which included a content filtering feature which could block "pornographic images". We ended up turning it off as it had too many false positives since it was an insurance company that dealt with injuries so a lot of legitimate injury photos would get classed as porn and blocked. I think it was basically looking at how much of an ima…

I used to work at a place that blocked a significant fraction of incoming Dutch emails. Eventually we figured out it rejected any message with "kunt" ("he/she can"), which is not exactly uncommon. Apparently they were flagged as deliberate attempts to circumvent the profanity filter.

good ol' email filters with the *.stud.university.edu emails (stud as in student)...

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#172

Post by panda-giddiness »

yosito wrote: post #164
panda-giddiness wrote: post #155

Earlier quoted context omitted.

> Yet, as rare as it might be, there are people of both genders who actually enjoy receiving unsolicited nudes. And people who enjoy sexual pickup lines. The judgement call of what is/isn't going to be attractive or appropriate ought be to left in the hands of the individuals dating as much as possible rather than controlled by a priest at a tech company. I don't understand. Are you suggesting that Bumble should allo…

I'm suggesting that Bumble shouldn't be the judge of what messages are appropriate to send or not. But they absolutely should provide filtering tools and feedback to users to reduce low quality or obnoxious behavior. I don't disagree with you that a majority of women do not want unsolicited nudes. But there's not a consensus or black and white line between messages that are wanted or unwanted. Not all women are purit…

> I'm suggesting that Bumble shouldn't be the judge of what messages are appropriate to send or not. But they absolutely should provide filtering tools and feedback to users to reduce low quality or obnoxious behavior.

That's an untenable position. Bumble should (and does) block pornographic, illegal, or harassing content. As already mentioned in the post, sending unsolicited nudes is illegal in at least one jurisdiction, so it's hardly a stretch to include unsolicited nudes in this category.

> But they absolutely should provide filtering tools and feedback to users to reduce low quality or obnoxious behavior. [...] I'm advocating for sensible filters and feedback, rather than moralistic censorship.

Isn't that exactly what this feature is? Users still have the option to view potential nudes; they just aren't exposed by default. It seems obvious that the feature should be opt-out (rather than opt-in), given that the majority of users would prefer not to be exposed to unsolicited nudes.

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#173

Post by z9znz »

lucasfcosta wrote: post #116
runlevel1 wrote: post #64

Around 2007, there was an image board type of site that was struggling to build a system that could reliably detect these sort of images. Their solution ended up being to run it through face detection first -- which was pretty reliable even back then. It turns out, people who sent unsolicited lewd photos tended to do so without their face in frame. So if a face was detected, it was significantly less likely to be lew…

An excellent example of cutting the Gordian Knot: https://en.wikipedia.org/wiki/Gordian_Knot

Are you making some kind of Freudian Slit?

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#174

Post by qubex »

Natfan wrote: post #169
qubex wrote: post #161

As a nudist I find it increasingly frustrating battling all these well-meaning impediments every firm seems to be throwing up everywhere for the sake of combating pornography. Latest discovery is that iOS’s new “press to copy person” doesn’t work if the person is undressed, which makes sense if they’re trying to ensure it doesn’t facilitate copy-and-paste porn of the lowest calibre but… sheesh. I don’t understand why…

I'm reminded of the following description of the electronic thumb from Doulgas Adams' The Hitchhikers' Guide to the Galaxy[0]: --- > *Electronic Thumb* > A short squat black rod, smooth and matte with a couple of flat switches and dials at one end. It allows Hitchhikers to flag down passing spacecraft to hitch a lift. > The Thumb is used by Hitchhikers throughout the Galaxy to steal a ride aboard starships who's oper…

Indeed.

Either way those of my persuasion are the invisible collateral damage nobody cares enough to even factor into the equation.

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#175

Post by lhenault »

That's commendable from them and a step in the right direction to address a real problem. Unsolicited nudes are considered as sexual assault, and illegal in many countries.

However, I wonder if that's genuine or some PR stunt, as it's "simply" a binary classifier using an off-the-shelf architecture (EfficientNet v2), and having the trained model being publicly released can now allow adversarial attacks.

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#176

Post by panda-giddiness »

koolba wrote: post #163
panda-giddiness wrote: post #155

Earlier quoted context omitted.

> Yet, as rare as it might be, there are people of both genders who actually enjoy receiving unsolicited nudes. And people who enjoy sexual pickup lines. The judgement call of what is/isn't going to be attractive or appropriate ought be to left in the hands of the individuals dating as much as possible rather than controlled by a priest at a tech company. I don't understand. Are you suggesting that Bumble should allo…

> Are you suggesting that Bumble should allow users to send unsolicited nudes to strangers, despite the vast majority of women not appreciating that? Why would any company want to intentionally degrade the experience of roughly half their users? Why must it be one or the other? They could have a per-user flag to opt in to unsolicited nudes. Even better, a more fine grained series of flags or enums indicating the leve…

> Why must it be one or the other? They could have a per-user flag to opt in to unsolicited nudes.

I mean, isn't Bumble's implementation effectively that? Users can still view the potential nudes if they want.

In the abstract, I don't mind if Bumble wants to add a such a flag. In practice, I doubt they will since (1) it's a feature few people are likely to use and (2) the potential for bad press is high ("Woman Receives Thousands of Unwanted Nudes on Bumble after Accidentally Changing Settings").

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#177

Post by sweetheart »

qubex wrote: post #165
yosito wrote: post #130

I was permanently banned from Tinder for trying to upload a picture of myself holding a pepper from my garden. I can only assume that Tinder's AI thought the pepper looked like an unacceptable body part. I am absolutely in favor of using AI to combat unsolicited nudes as long as it's implemented something like: on the sender's side, show a warning before sending that the image appears to be in bad taste and asking fo…

> rare as it might be, there are people of both genders who actually enjoy receiving unsolicited nudes I’m a nudist. I don’t enjoy receiving “unsolicited nudes” but a lot of acquaintances from that zone of my life do send photographs that sometimes depict them undressed in pursuit of whatever activity it is they’re depicting — usually the body in the picture is not the point of the exercise. This just impedes the day…

I get why this would be incredibly annoying to a nudist, but I can’t really see a path forward that works for nudists and non nudists in this context.

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#179

Post by sweetheart »

1letterunixname wrote: post #139
yosito wrote: post #130

I was permanently banned from Tinder for trying to upload a picture of myself holding a pepper from my garden. I can only assume that Tinder's AI thought the pepper looked like an unacceptable body part. I am absolutely in favor of using AI to combat unsolicited nudes as long as it's implemented something like: on the sender's side, show a warning before sending that the image appears to be in bad taste and asking fo…

That's hilarious. I would take that as a sign the platform is as thoughtful with arbitrary enforcement (without review) and that it's users aren't much sharper.

Why do you take it to mean that people who use a dating app are somewhat dumb? I can’t understand how you’d think that from Tinder misclassifying a photo

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#180

Post by oneoff786 »

logicalmonster wrote: post #43
oneoff786 wrote: post #36

Earlier quoted context omitted.

Quoted post unavailable.

I realize that this isn't exactly Reddit, but good God man, has the capacity for a simple self-deprecating joke been lost here?

I don’t get it? Are they suggesting then that their normal photos are being tagged as lewd?
Post reply on HN