Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bumble releases open-source A.I. feature to help combat unsolicited nudes

bumble.com

Post reply on HN
Print view View original

61–70 of 255 posts

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#61

Post by monktastic1 »

dinosaurdynasty wrote: post #45
monktastic1 wrote: post #15

Earlier quoted context omitted.

Really? I would have guessed most people would want to know who the "toxic" people are in their life so that they can take appropriate action instead of finding out in a worse way later.

I think the idea is "automatically block people who send dick pics" and not "silently remove dick pics but allow other messages from the same person". Considering what Bumble/Tinder are maybe this makes sense?

Ah, thanks. My parent comment makes way more sense to me in that light.

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#62

Post by returnzero »

Many years ago (ca. 2009?) at a previous employer we had an enterprise email scanner which included a content filtering feature which could block "pornographic images". We ended up turning it off as it had too many false positives since it was an insurance company that dealt with injuries so a lot of legitimate injury photos would get classed as porn and blocked. I think it was basically looking at how much of an image was skin tones.

The more interesting thing about that feature was that it A) only blocked nude images of white people, and B) would aggressively block photos of golden retrievers much to the annoyance of someone in the claims team who bred them and occasionally received photos to her work email.

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#63

Post by [deleted] »

andirk wrote: post #29
XorNot wrote: post #10

Earlier quoted context omitted.

This is an interesting question, because it can be unpleasant to know that the attempt had even happened. I suspect given the option, most people would turn on an option for "block dick pics silently" and leave it on. Similar to how I never actually check my spam folder anymore.

Dick pics folder is the new spam folder? What does this say about society, that we've gotten better or worse?

[deleted]

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#64

Post by runlevel1 »

Around 2007, there was an image board type of site that was struggling to build a system that could reliably detect these sort of images.

Their solution ended up being to run it through face detection first -- which was pretty reliable even back then.

It turns out, people who sent unsolicited lewd photos tended to do so without their face in frame. So if a face was detected, it was significantly less likely to be lewd.

Just an amusing anecdote. Wish I could find the blog post describing it.

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#66

Post by smt88 »

user- wrote: post #32

Can they open source their algorithirm so I can figure out why I get no matches

Dating apps are tailored to people in the top X% of attractiveness. Don't take it personally. Most people aren't successful on them, even the ones who get a lot of matches.

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#67

Post by comboy »

lern_too_spel wrote: post #47
minimaxir wrote: post #14

I wonder if there is a way to use this to finetune an image generating AI to generate images that the AI would think is lewd but is not. (similar to what was done with a Yahoo model in 2016: https://news.ycombinator.com/item?id=12756462 ) Archive of the original post (NSFW?): https://web.archive.org/web/20161022003102/https://open_nsfw...

More likely is people making adversarial dick pics to get past the filter, which is very quick to do when you have the parameters of a differentiable model. I noticed they were careful to state that they are releasing a model instead of the model they are using though.

venn

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#68

Post by paul7986 »

andirk wrote: post #29
XorNot wrote: post #10

Earlier quoted context omitted.

This is an interesting question, because it can be unpleasant to know that the attempt had even happened. I suspect given the option, most people would turn on an option for "block dick pics silently" and leave it on. Similar to how I never actually check my spam folder anymore.

Dick pics folder is the new spam folder? What does this say about society, that we've gotten better or worse?

We have been secretly, yet proudly drawing our members on stone walls since the dawn of time.

In Centralia, PA there use to be something called Grafitti Highway. It's an old highway road (they created a new road around it) that people would go and graffiti this old, unused highway. It might as been called Penis Highway as innately that's what was mostly drawn there. Too bad they shut it down lol

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#69

Post by cercatrova »

jedberg wrote: post #65
alberth wrote: post #40

Hot Dog / Not Hot Dog.

What I wonder is if they actually came up with the idea because of that. The timing is about right.

In the show, Jian Yang sells the app to a social media company for precisely detecting this sort of phallic imagery, so I think Mike Judge knew exactly what he was doing.
Post reply on HN