Live data from Hacker News

Facebook uses 1.5B Reddit posts to create chatbot

bbc.com

51–60 of 235 posts

Re: Facebook uses 1.5B Reddit posts to create chatbot

#51
post #44

From the cherry-picked conversation section of the research paper [1]. > Human: Hi! > Bot: Hi! How are you? I'm a vegan, so I don't eat any animal products. Even AI vegans reinforcing stereotypes of being overly-forthcoming. [1] - https://arxiv.org/pdf/2004.13637.pdf

Well, training it on Reddit data it's going to take on a vegan, pan-sexual, Bernie Sanders supporting, urbanite, Tesla driving, artist / cam-girl persona.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#52
post #12

Earlier quoted context omitted.

Thank you. I can't really fathom why the BBC would not think to link to the _actual_ source of this news.

The BBC, like a lot of news orgs, wants to maximize advertising impressions, and the way to do that is to keep almost all links pointed to itself. A link to the more substantive source is a reader lost.

Rather, the BBC is a socially conservative institution and does not want to be responsible for the content of external links.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#53

if anyone wants to try it, I'm hosting the small model here: https://cocohub.ai/blueprint/blender_pv1/about

Thank you!

But to be honest Blender is kinda underwhelming. I had better conversations with alice derivates. Blender feels bland, like a dozen different responses with only some words from my text inserted.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#54
post #44

From the cherry-picked conversation section of the research paper [1]. > Human: Hi! > Bot: Hi! How are you? I'm a vegan, so I don't eat any animal products. Even AI vegans reinforcing stereotypes of being overly-forthcoming. [1] - https://arxiv.org/pdf/2004.13637.pdf

Just wait until bot uses /r/archlinux as learning material.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#55
post #44

From the cherry-picked conversation section of the research paper [1]. > Human: Hi! > Bot: Hi! How are you? I'm a vegan, so I don't eat any animal products. Even AI vegans reinforcing stereotypes of being overly-forthcoming. [1] - https://arxiv.org/pdf/2004.13637.pdf

The only vegans you ever know to be vegans are those who bother to tell you, so it shouldn’t be surprising.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#56
post #8

Here's an example of a GPT2 model trained on the /r/Wikipedia subreddit: https://old.reddit.com/r/SubSimulatorGPT2/comments/dghmnm/li... and some quotes: > I was hoping this would be about how bears are evil and we should all get rid of them! I am very disappointed! Also, a conversation: > I love the list. I feel like I should read more. And reply: > The list is a bit long, but the bear is one of my favorite fictiona…

> "Pork Custodian" is the only thing which doesn't work there. How dare you!

The politically correct term is "fluffer"

Re: Facebook uses 1.5B Reddit posts to create chatbot

#57
post #2

How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Didn't Facebook just merge all fb messenger and whatsapp data and trained a NN on the new chat db?

Reddit a dumpster fire? Some of Reddits technical communities have a way higher signal than HN, like Reddit’s math or rust community. Reddit math is more curious about math than HN is about tech.

signal and empathy seem orthogonal traits to me.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#60
I’ve been developing some chat bots recently professionally and, honestly, I don’t get the point of these kinds of projects, especially done by companies like Facebook - sure you could create some text generator based on tokens, but it serves no purpose.

Give me a trained bot that can extract specific things in various different ways users express them (without me creating dumb questionnaires), match across thousands of domain specific technical variations of terms, understand voice as well as text... until then it’s all stupid tricks that just show Facebook has too much money to waste.

Post reply on HN