Live data from Hacker News

Facebook uses 1.5B Reddit posts to create chatbot

bbc.com

71–80 of 235 posts

Re: Facebook uses 1.5B Reddit posts to create chatbot

#72
post #2

How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Didn't Facebook just merge all fb messenger and whatsapp data and trained a NN on the new chat db?

Reddit a dumpster fire? Some of Reddits technical communities have a way higher signal than HN, like Reddit’s math or rust community. Reddit math is more curious about math than HN is about tech.

[deleted]

Re: Facebook uses 1.5B Reddit posts to create chatbot

#73
post #44

From the cherry-picked conversation section of the research paper [1]. > Human: Hi! > Bot: Hi! How are you? I'm a vegan, so I don't eat any animal products. Even AI vegans reinforcing stereotypes of being overly-forthcoming. [1] - https://arxiv.org/pdf/2004.13637.pdf

Well, training it on Reddit data it's going to take on a vegan, pan-sexual, Bernie Sanders supporting, urbanite, Tesla driving, artist / cam-girl persona.

[deleted]

Re: Facebook uses 1.5B Reddit posts to create chatbot

#74

if anyone wants to try it, I'm hosting the small model here: https://cocohub.ai/blueprint/blender_pv1/about

Hi there. One of the original authors of the BlenderBot paper here. This cocohub website is not what we released. It appears that cocohub has removed our safety layer and provided other modifications to the bot. We released our model open source, along with specific instructions on interacting with it safely: https://parl.ai/projects/recipes/ It's important to note that dialogue safety is a very important and nuanced…

Hi stephenroller, I posted it as is (without the bad words filter). I also think it's very clear the model reflects the training data. And also kudos and thanks for releasing the code along with the paper. I'm obviously not claiming this a bot by facebook just research made accessible. let me know if you'd like to amend any of the texts next to it to make it any clearer. (just tried to properly credit the creators)

Re: Facebook uses 1.5B Reddit posts to create chatbot

#75
post #2

How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Didn't Facebook just merge all fb messenger and whatsapp data and trained a NN on the new chat db?

To even have a snowball's chance at success, they would have had to make use of reddit's voting system. Tons of toxicity and disinformation still makes it up into highly upvoted comments, but I'd expect throwing away heavily downvoted comments to exclude a good fraction of the utter crap.

downvotes are not necessarily indicative of bad ideas or comment but more about alignment to each specific sub-reddit groupthink.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#76
post #2

How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Didn't Facebook just merge all fb messenger and whatsapp data and trained a NN on the new chat db?

Hi, paper author here. The model was fine-tuned on (non-Reddit) data that was specifically designed to give it positive conversational skills, like empathy, knowledge, and personality (see: https://arxiv.org/abs/2004.13637).

No FB data was used to train these models, which is what allowed us to open source it.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#77
post #71

Blog post: https://ai.facebook.com/blog/state-of-the-art-open-source-ch... Paper: https://arxiv.org/pdf/2004.13637.pdf Open Source: https://parl.ai/projects/recipes/ Ask us anything, the Facebook team behind it is happy to answer questions here.

How do you feel about this probably being most used by bad actors trying to screw with society and elections?

Re: Facebook uses 1.5B Reddit posts to create chatbot

#78
post #55

Earlier quoted context omitted.

The only vegans you ever know to be vegans are those who bother to tell you, so it shouldn’t be surprising.

Work lunches, weddings, and so forth are a control for that. My experience is you always know who the vegans are in advance. Although I have learned from that that you need to hover around the vegan dishes to stop the non-vegans from eating it all before the vegans get to it, or order far more than should be needed.

Good food is good food. Some good food happens to be vegan. It isn't hugely "special" especially these days, when Indian food is reasonably popular; this, incidentally, debunks the notion that vegans all eat weird concoctions of soy meant to resemble meat. I'm sure some do, but a curry which happens to contain no animal products is much more appealing.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#80
post #71

Blog post: https://ai.facebook.com/blog/state-of-the-art-open-source-ch... Paper: https://arxiv.org/pdf/2004.13637.pdf Open Source: https://parl.ai/projects/recipes/ Ask us anything, the Facebook team behind it is happy to answer questions here.

How consistent is the bot? Will it answer the same question phrased differently with the same opinion/fact/feeling?
Post reply on HN