Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bumble releases open-source A.I. feature to help combat unsolicited nudes

bumble.com

Post reply on HN
Print view View original

111–120 of 255 posts

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#111

Post by dorkwood »

returnzero wrote: post #62

Many years ago (ca. 2009?) at a previous employer we had an enterprise email scanner which included a content filtering feature which could block "pornographic images". We ended up turning it off as it had too many false positives since it was an insurance company that dealt with injuries so a lot of legitimate injury photos would get classed as porn and blocked. I think it was basically looking at how much of an ima…

I once tried to post an image to Discord over and over, only to keep receiving one of those "there's been a problem" messages.

It turned out the untextured 3D pig's head in my image was tripping Discord's porno filter. I can only assume it was the shape of its snout.

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#112

Post by mikepurvis »

w-ll wrote: post #95
ramesh31 wrote: post #87

Earlier quoted context omitted.

There was an XKCD comic around that timeframe: https://xkcd.com/1425/ And it really sticks out as one of the few paradigm shifts we’ve had in the last 10 years. In 2009, it really was an impossible task to do that kind of image recognition. But by 2012, it was available in a library for anyone.

Even outside of image recognition, this is my most common referenced XKCD comic, with non tech managers trying to guess timelines of work.

That honour goes to 927 in my circles, and it's not even close.

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#113

Post by godmode2019 »

borissk wrote: post #88
godmode2019 wrote: post #83

Earlier quoted context omitted.

I'm relevantly good looking, no problem with getting a beautiful woman IRL, but on dating apps I get no matches. Or if I do its girls who are either average or tinder addicts who everyone should avoid. My working theory is on a dating app woman have unlimited access, so tend to go torwards the top 99.9% of men. Solution: Shadow ban hyper attractive people. Solution 2: Only show people a similar level of attractivenes…

Your theory makes no sense. First you obviously mean the top 0.1% of men. Second the top 0.1% of men can't date more than a few percent of the women. Much more likely you don't put enough effort into your profile or you have something on, that is a red flag for most women.

Yes I did mean the top 0.1% of men.

I disagree with that the top man can not date more than a few.

A single woman needs a romantic partner let's say ever three months, a man can have one every day. We see this in gay men having 500+ average sexual partners. Gay men can have sex as much as they want, because of access.

Top 0.1% of men can also have sex when ever they want, they are getting constant matches with 6,7,8 level woman. Well below their level, because its easier to get people below your level into bed without courting.

They have sex, he doesn't call her back, she is mad at men for another three months.

A few men can soak up all of the above average woman, considering they are on a bell curve and are rare them self. Only a subset of people are even on these dating apps.

Average looking people don't have this problem, because they are happy with matching other average woman who the top men are not interested in.

Summary: top men can date below their own level because a 7 woman, three below them is still very beautiful. But a 7 man can't date three below their own level because a 4 is not attractive and not worth the time using a app for.

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#114

Post by fasthands9 »

nl wrote: post #55
version_five wrote: post #6

I'm most interested in how they handle it for the users. It says potential "nudes" are blurred and can be "reported" or viewed. Will it tell the sender they're sending something that's going to be blurred? (which on one hand would let them resolve a false positive but also maybe let them find an adversarial image).

It doesn't tell the sender. Both dick pics and boob pics are blurred. I'd note that the title here is slightly misleading. It doesn't do anything to check if the pics are solicited or not.

My recollection of Bumble is that all images were blurred (at least until you already sent pictures to each other?)

While I imagine having a good filter is important given the scale of online dating I would think all other filters would eliminate most of the problem (auto blurring images if people have only sent a few messages to each other, blur the first image sent, blur images by anyone who has been reported before, etc.)

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#115

Post by BuyMyBitcoins »

tonymet wrote: post #78
dtdynasty wrote: post #74

Funnily enough one of my SFW pictures got detected recently on bumble and my working theory is that they detected my phone as a bulge. It might be fun to try to test what type of content it misidentifies. Edit: missing "to"

20 years ago when candy bar phones were popular i designed a dildo-shaped phone case – a sort of “push up bra” for men. Not sure why my product never took off.

Alternatively: “My cellphone case design had a bad reception”.

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#116

Post by lucasfcosta »

runlevel1 wrote: post #64

Around 2007, there was an image board type of site that was struggling to build a system that could reliably detect these sort of images. Their solution ended up being to run it through face detection first -- which was pretty reliable even back then. It turns out, people who sent unsolicited lewd photos tended to do so without their face in frame. So if a face was detected, it was significantly less likely to be lew…

An excellent example of cutting the Gordian Knot: https://en.wikipedia.org/wiki/Gordian_Knot

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#117

Post by m00x »

tonymet wrote: post #78
dtdynasty wrote: post #74

Funnily enough one of my SFW pictures got detected recently on bumble and my working theory is that they detected my phone as a bulge. It might be fun to try to test what type of content it misidentifies. Edit: missing "to"

20 years ago when candy bar phones were popular i designed a dildo-shaped phone case – a sort of “push up bra” for men. Not sure why my product never took off.

You should have gone to VCs. Maybe could've raised some capital. Could've been huge!

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#119

Post by HeavenFox »

returnzero wrote: post #62

Many years ago (ca. 2009?) at a previous employer we had an enterprise email scanner which included a content filtering feature which could block "pornographic images". We ended up turning it off as it had too many false positives since it was an insurance company that dealt with injuries so a lot of legitimate injury photos would get classed as porn and blocked. I think it was basically looking at how much of an ima…

In China:

* During COVID, a medical school professor complains his class livestream would get cut off constantly without warning because he is teaching anatomy and showing pictures.

* Civics class online quiz. Multiple choice question. A: *; B: *; C: *; D: * - apparently all four choices are censored because they are names of Chinese leader.

* A police officer complains his files related to a rape case he is investigating was deleted by the cloud service provider

Re: Bumble releases open-source A.I. feature to help combat unsolicited nudes

#120

Post by mikepurvis »

paul7986 wrote: post #68
andirk wrote: post #29

Earlier quoted context omitted.

Dick pics folder is the new spam folder? What does this say about society, that we've gotten better or worse?

We have been secretly, yet proudly drawing our members on stone walls since the dawn of time. In Centralia, PA there use to be something called Grafitti Highway. It's an old highway road (they created a new road around it) that people would go and graffiti this old, unused highway. It might as been called Penis Highway as innately that's what was mostly drawn there. Too bad they shut it down lol

Then there's this: https://en.wikipedia.org/wiki/Panty_tree

(Which I think is still mostly guys doing it, at least historically...)

Post reply on HN