Facebook uses 1.5B Reddit posts to create chatbot • Hacker News Board

Re: Facebook uses 1.5B Reddit posts to create chatbot

#211

Post by colordrops » Thu, May 07, 2020, 8:08 AM UTC

ori_b wrote: post #138

phreeza wrote: post #110

Earlier quoted context omitted.

Defending against such an "attack" is much easier if the technology is widely available and many people can play around with it and explore the limits.

So is crafting such an attack. Given that the attacks are obvious, and I haven't seen much word on defenses, the result seems inevitable.

At some point you have to let the rest of society in on it. As technology advances, if you keep the power away from the public, eventually you will split into two civilizations a vast divide creating an asymmetry that will be exploited by those on the elite side of the divide. It must be an aspect of technological rollout to figure out how to keep its usage safe once it is widespread.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#212

Post by hutzlibu » Thu, May 07, 2020, 8:22 AM UTC

colordrops wrote: post #208

hutzlibu wrote: post #207

Earlier quoted context omitted.

That sounds like total overkill. To deanonymize a reddit account, it is easier to just use a add/cookie/script on reddit to link it to your facebook account you have open in another tab.

How exactly would you do that? Reddit doesn't allow random scripts by 3rd parties.

Ok, I don't know about any reddit details, but I just opened reddit.com without a adblocker and took a look in the network tab in the dev tools.

I mean, I don't see a plain facebook connection, but I see googleads and amazon connection and don't know what else obscure things. I doubt it would be hard to sneak something in, that just checks whether this is the same browser where you just switched over from the facebook tab (where the onblur event just got captured). But again, I am not an expert in tracking ads, nor reddit, I just know the web and its various data transmitting technices quite good.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#213

Post by bluntfang » Thu, May 07, 2020, 10:38 AM UTC

GeneralMaximus wrote: post #201

hnick wrote: post #192

Earlier quoted context omitted.

They use a fair bit of ghee don't they? I went from memory but Wikipedia seems to agree with that. "Ghee is widely used in South Indian cuisine for tempering curries, in preparation of rice dishes and sweets. South Indians have a habit of adding ghee to their rice before eating it with pickles and curries. South Indians are one of the biggest consumers of ghee."

While everything tastes better with ghee, you can cook a lot of Indian food using plant-based oils. I use sunflower oil for a lot of dishes, but you can also use vegetable oil, olive oil, or mustard oil. With a bit of effort, you can eliminate animal products from most vegetarian Indian food. It will taste different, but not too much. Source: I'm Indian.

I don't think anyways arguing that oil isn't a replacement for butter. I think we're curious about the expectation. Can we expect most Indian restaurants or caterers to use oils instead of ghee? Do you need to ask them if they use ghee?

Re: Facebook uses 1.5B Reddit posts to create chatbot

#214

Post by michaelcampbell » Thu, May 07, 2020, 11:07 AM UTC

M2Ys4U wrote: post #3

> Numerous issues arose during longer conversations. Blender would sometimes respond with offensive language, and at other times it would make up facts altogether. I mean, to be fair, I've had many conversations like that...

> > Blender would sometimes respond with offensive language, and at other times it would make up facts altogether.

So EXACTLY like reddit, then.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#215

Post by michaelcampbell » Thu, May 07, 2020, 11:08 AM UTC

woutr_be wrote: post #164

M2Ys4U wrote: post #3

> Numerous issues arose during longer conversations. Blender would sometimes respond with offensive language, and at other times it would make up facts altogether. I mean, to be fair, I've had many conversations like that...

It’s one of the reasons I refuse to open Reddit anymore, 95% of the comments are insults, made up facts, misinformation or people living in their own bubble and refusing to accept any opinion other than their own.

What percent is made up statistics?

Re: Facebook uses 1.5B Reddit posts to create chatbot

#216

Post by swebs » Thu, May 07, 2020, 11:08 AM UTC

M2Ys4U wrote: post #3

> Numerous issues arose during longer conversations. Blender would sometimes respond with offensive language, and at other times it would make up facts altogether. I mean, to be fair, I've had many conversations like that...

>and at other times it would make up facts altogether

Isn't that the entire point of an AI?

Re: Facebook uses 1.5B Reddit posts to create chatbot

#217

Post by GeneralMaximus » Thu, May 07, 2020, 11:20 AM UTC

bluntfang wrote: post #213

GeneralMaximus wrote: post #201

Earlier quoted context omitted.

While everything tastes better with ghee, you can cook a lot of Indian food using plant-based oils. I use sunflower oil for a lot of dishes, but you can also use vegetable oil, olive oil, or mustard oil. With a bit of effort, you can eliminate animal products from most vegetarian Indian food. It will taste different, but not too much. Source: I'm Indian.

I don't think anyways arguing that oil isn't a replacement for butter. I think we're curious about the expectation. Can we expect most Indian restaurants or caterers to use oils instead of ghee? Do you need to ask them if they use ghee?

Fancy Indian restaurants in the West as well as back here are almost certainly using ghee. Cheaper places might use vanaspati (a ghee substitute made with palm oil) or oil. In general, though, you can never tell for sure unless you're doing the cooking yourself.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#218

Post by yosito » Thu, May 07, 2020, 11:24 AM UTC

I'm having nightmares about a dystopian future in which I scream into the void of a Facebook chat bot and hear a response from the voice of a billion anonymous redditors.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#219

Post by pesenti » Thu, May 07, 2020, 2:10 PM UTC

PlasticTank wrote: post #210

pesenti wrote: post #71

Blog post: https://ai.facebook.com/blog/state-of-the-art-open-source-ch... Paper: https://arxiv.org/pdf/2004.13637.pdf Open Source: https://parl.ai/projects/recipes/ Ask us anything, the Facebook team behind it is happy to answer questions here.

How long until you have to shutdown because it starts getting offensive like Tay?

The team put a lot of effort on dialog safety. You can find more info here: https://parl.ai/projects/dialogue_safety/ and the paper here: https://arxiv.org/abs/1908.06083.

Still, unlike Tay, we purposely did not create a service for it and do not advise creating one. This is for research purpose only and more effort needs to be made on safety before it can me more broadly consumed.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#220

Post by pesenti » Thu, May 07, 2020, 2:13 PM UTC

ma2rten wrote: post #150

pesenti wrote: post #71

Blog post: https://ai.facebook.com/blog/state-of-the-art-open-source-ch... Paper: https://arxiv.org/pdf/2004.13637.pdf Open Source: https://parl.ai/projects/recipes/ Ask us anything, the Facebook team behind it is happy to answer questions here.

For most the evaluations you reported at engagingness (expect Figure 16). Did you also look humanness? I would be especially interested how human your chatbot is compared to real humans (Figure 17). This would be similar to a turning test.

The bot is really optimized on engagingness rather than humanness - in particular this is how we chose the hyper parameters. We did evaluate Meena vs. Human (31 vs. 69) and Meena vs. BlenderBot (35 vs. 65). But didn't do BlenderBot vs. Human. Good suggestion though.