What i really wonder is why they trained it on Reddit data, not on their own datasets?
Facebook uses 1.5B Reddit posts to create chatbot
21–30 of 235 posts
Re: Facebook uses 1.5B Reddit posts to create chatbot
#22A reminder that you can obtain the majority of Reddit posts/comments via BigQuery (via Pushshift). No need to write your own scraper.
https://console.cloud.google.com/bigquery?p=fh-bigquery&d=re...
https://console.cloud.google.com/bigquery?p=fh-bigquery&d=re...
It appears to be roughly up to August 2019 for posts, October 2019 for comments.
Re: Facebook uses 1.5B Reddit posts to create chatbot
#23How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Didn't Facebook just merge all fb messenger and whatsapp data and trained a NN on the new chat db?
I'd love to see Facebook train a chatbot using messenger data only from conversations between people and their grandmothers.
Obviously this is creepy because of privacy concerns, but I would love if I could pick the 'personality' of my chatbot, so that it responded to me in language and tone more like a responsible adult and not an average redditor.
Of course you could always run it the opposite way and get a chatbot that responds like a teenage daughter does to her parents. That would be both equally hilarious and painful.
Re: Facebook uses 1.5B Reddit posts to create chatbot
#24How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Didn't Facebook just merge all fb messenger and whatsapp data and trained a NN on the new chat db?
> How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human?
Because people who say “Reddit is a dumpster fire” are usually just thinking of r/Politics, RedPill, TheDonald, LateStageCapitalism, basically any remotely political subreddit... when, in reality, there are plenty of subreddits where quality conversation can be had and some where people just share art or animal pictures, and these are pleasant places to kill some time (although there’s almost always per-subreddit groupthink, but it’s not like HN doesn’t also suffer from that in some cases).
Re: Facebook uses 1.5B Reddit posts to create chatbot
#25Here's an example of a GPT2 model trained on the /r/Wikipedia subreddit: https://old.reddit.com/r/SubSimulatorGPT2/comments/dghmnm/li... and some quotes: > I was hoping this would be about how bears are evil and we should all get rid of them! I am very disappointed! Also, a conversation: > I love the list. I feel like I should read more. And reply: > The list is a bit long, but the bear is one of my favorite fictiona…
>"Pork Custodian" is the only thing which doesn't work there.
How dare you!
Re: Facebook uses 1.5B Reddit posts to create chatbot
#26> Numerous issues arose during longer conversations. Blender would sometimes respond with offensive language, and at other times it would make up facts altogether. I mean, to be fair, I've had many conversations like that...
[deleted]
Re: Facebook uses 1.5B Reddit posts to create chatbot
#27How unfair that a walled garden is using open community's data.
Re: Facebook uses 1.5B Reddit posts to create chatbot
#28How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Didn't Facebook just merge all fb messenger and whatsapp data and trained a NN on the new chat db?
To even have a snowball's chance at success, they would have had to make use of reddit's voting system. Tons of toxicity and disinformation still makes it up into highly upvoted comments, but I'd expect throwing away heavily downvoted comments to exclude a good fraction of the utter crap.
[deleted]
Re: Facebook uses 1.5B Reddit posts to create chatbot
#29How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Didn't Facebook just merge all fb messenger and whatsapp data and trained a NN on the new chat db?
> How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Because people who say “Reddit is a dumpster fire” are usually just thinking of r/Politics, RedPill, TheDonald, LateStageCapitalism, basically any remotely political subreddit... when, in reality, there are plenty of subreddits where quality conversation can be had and some where people just share art or animal…
Now if they also include everything from /r/subredditSimulator then this could all be really interesting
Re: Facebook uses 1.5B Reddit posts to create chatbot
#30How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Didn't Facebook just merge all fb messenger and whatsapp data and trained a NN on the new chat db?
> How can facebook turn a dumpster fire like reddit in a bot that response with more empathy than a human? Because people who say “Reddit is a dumpster fire” are usually just thinking of r/Politics, RedPill, TheDonald, LateStageCapitalism, basically any remotely political subreddit... when, in reality, there are plenty of subreddits where quality conversation can be had and some where people just share art or animal…
Yeah I think a huge advantage Reddit has over other social networks is that it's broken up into myriad communities which are able to develop their own norms and self-govern to some degree. In smaller communities, this totally sidesteps some of the issues you have on a platform like Twitter, where people with very different beliefs and assumptions are essentially having conversations about how much they don't like each-other in the same room.