Live data from Hacker News

Facebook uses 1.5B Reddit posts to create chatbot

bbc.com

81–90 of 235 posts

Re: Facebook uses 1.5B Reddit posts to create chatbot

#81
post #55
post #44

From the cherry-picked conversation section of the research paper [1]. > Human: Hi! > Bot: Hi! How are you? I'm a vegan, so I don't eat any animal products. Even AI vegans reinforcing stereotypes of being overly-forthcoming. [1] - https://arxiv.org/pdf/2004.13637.pdf

The only vegans you ever know to be vegans are those who bother to tell you, so it shouldn’t be surprising.

thatsthejoke.jpg

Re: Facebook uses 1.5B Reddit posts to create chatbot

#82
post #2

How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Didn't Facebook just merge all fb messenger and whatsapp data and trained a NN on the new chat db?

Reddit has no shortage of problems, but it's the most civilized large online discussion platform by far.

Moderation, partitioning of interests into subreddits, and the existence of downvotes go a long way to reeling in the worst things about online discussions.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#83

Earlier quoted context omitted.

Hi there. One of the original authors of the BlenderBot paper here. This cocohub website is not what we released. It appears that cocohub has removed our safety layer and provided other modifications to the bot. We released our model open source, along with specific instructions on interacting with it safely: https://parl.ai/projects/recipes/ It's important to note that dialogue safety is a very important and nuanced…

Hi stephenroller, I posted it as is (without the bad words filter). I also think it's very clear the model reflects the training data. And also kudos and thanks for releasing the code along with the paper. I'm obviously not claiming this a bot by facebook just research made accessible. let me know if you'd like to amend any of the texts next to it to make it any clearer. (just tried to properly credit the creators)

Hi there, thanks for asking! It's very cool to make research more accessible. Would you be able to rename your experience to "Modified Small BlenderBot without Safety Layer"? And I think it’d be helpful to call out what changes you made when you say it’s adapted from our research.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#85

Earlier quoted context omitted.

Hi stephenroller, I posted it as is (without the bad words filter). I also think it's very clear the model reflects the training data. And also kudos and thanks for releasing the code along with the paper. I'm obviously not claiming this a bot by facebook just research made accessible. let me know if you'd like to amend any of the texts next to it to make it any clearer. (just tried to properly credit the creators)

Hi there, thanks for asking! It's very cool to make research more accessible. Would you be able to rename your experience to "Modified Small BlenderBot without Safety Layer"? And I think it’d be helpful to call out what changes you made when you say it’s adapted from our research.

Sure! will do now

Re: Facebook uses 1.5B Reddit posts to create chatbot

#86
post #71

Blog post: https://ai.facebook.com/blog/state-of-the-art-open-source-ch... Paper: https://arxiv.org/pdf/2004.13637.pdf Open Source: https://parl.ai/projects/recipes/ Ask us anything, the Facebook team behind it is happy to answer questions here.

How do you feel about this probably being most used by bad actors trying to screw with society and elections?

That's definitely a fair concern. We believe that open science and transparency are the right approach here. By releasing it, we ensure that everyone is on the same page with respect to abilities and defense.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#87
post #71

Blog post: https://ai.facebook.com/blog/state-of-the-art-open-source-ch... Paper: https://arxiv.org/pdf/2004.13637.pdf Open Source: https://parl.ai/projects/recipes/ Ask us anything, the Facebook team behind it is happy to answer questions here.

How consistent is the bot? Will it answer the same question phrased differently with the same opinion/fact/feeling?

One of the tasks that we fine-tuned the model on is ConvAI2 (or "Persona-chat") which specifically aims to improve the model's consistency by conditioning its responses on a given persona. See here: https://arxiv.org/abs/1801.07243. In this research we found that conditioning on a persona improves consistency, but that the models still aren't always perfectly consistent. In particular, the model can only see a few turns back in the dialogue history, and may contradict itself if the conversation is long enough that the model simply does not see the full conversation.

As far as facts go, we also fine-tuned the model on the Wizard of Wikipedia task (https://arxiv.org/abs/1811.01241), which helps improve its knowledgeability. Again, it still isn't perfect.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#88

Facebook Blog post with more information and longer chat session example: https://ai.facebook.com/blog/state-of-the-art-open-source-ch...

(BlenderBot original developer here) You can read the paper here, which contains much more technical details of how we built it: https://arxiv.org/abs/2004.13637

Re: Facebook uses 1.5B Reddit posts to create chatbot

#89
post #44

From the cherry-picked conversation section of the research paper [1]. > Human: Hi! > Bot: Hi! How are you? I'm a vegan, so I don't eat any animal products. Even AI vegans reinforcing stereotypes of being overly-forthcoming. [1] - https://arxiv.org/pdf/2004.13637.pdf

Just wait until bot uses /r/archlinux as learning material.

> Human: hi

> AI: I can't connect to the wifi.

Post reply on HN