Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Facebook uses 1.5B Reddit posts to create chatbot

bbc.com

Post reply on HN
Print view View original

101–110 of 235 posts

Re: Facebook uses 1.5B Reddit posts to create chatbot

#103

Post by hombre_fatal »

RealityVoid wrote: post #36
msla wrote: post #8

Here's an example of a GPT2 model trained on the /r/Wikipedia subreddit: https://old.reddit.com/r/SubSimulatorGPT2/comments/dghmnm/li... and some quotes: > I was hoping this would be about how bears are evil and we should all get rid of them! I am very disappointed! Also, a conversation: > I love the list. I feel like I should read more. And reply: > The list is a bit long, but the bear is one of my favorite fictiona…

One of my favourite threads on that subreddit were bots debating if they live in a simulation. Pretty funny, in a way. https://www.reddit.com/r/SubSimulatorGPT2/comments/ez6qtj/do...

Most of those comments are so human/Redditor that I'm now convinced at least 25% of Reddit comments come from bots. Plenty of these stupid interactions are at least as lucid/lame as standard Redditor banter/arguing.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#104

Post by dang »

minimaxir wrote: post #22

A reminder that you can obtain the majority of Reddit posts/comments via BigQuery (via Pushshift). No need to write your own scraper. https://console.cloud.google.com/bigquery?p=fh-bigquery&d=re... https://console.cloud.google.com/bigquery?p=fh-bigquery&d=re... It appears to be roughly up to August 2019 for posts, October 2019 for comments.

There's one for HN too, or at least used to be:

https://bigquery.cloud.google.com/dataset/bigquery-public-da...

Re: Facebook uses 1.5B Reddit posts to create chatbot

#105

Post by minimaxir »

dang wrote: post #104
minimaxir wrote: post #22

A reminder that you can obtain the majority of Reddit posts/comments via BigQuery (via Pushshift). No need to write your own scraper. https://console.cloud.google.com/bigquery?p=fh-bigquery&d=re... https://console.cloud.google.com/bigquery?p=fh-bigquery&d=re... It appears to be roughly up to August 2019 for posts, October 2019 for comments.

There's one for HN too, or at least used to be: https://bigquery.cloud.google.com/dataset/bigquery-public-da...

That's the correct URL. The `full` table appears to be up-to-date as of today.

That reminds me that I need to train a new Hacker News AI at some point. :)

Re: Facebook uses 1.5B Reddit posts to create chatbot

#107

Post by Cakez0r »

stephenroller wrote: post #99
Cakez0r wrote: post #92

Earlier quoted context omitted.

I was really blown away by the results you achieved. Amazing work! My jaw hit the floor when I saw the witty farewell "fun guy" quip, and I was in stitches when I read the song about baking. I look forward to the day I can take the model for a spin - unfortunately I don't have the requisite $18,000 hardware ;) I have a few questions: Could this be used as a tool to get a feel for public sentiment? For example, could…

I would not encourage using the model for anything other than AI research -- we're still in the early days of dialogue, and there are a lot of unexplored avenues. There are still nuances around safety, controlling generation, consistency, and knowledge involvement. For instance, the bot cannot remember what you said even a few turns ago, due to limitations in memory size. In the paper, we did explore what happens whe…

But toxicity and quality is subjective. The technical achievement is undeniably brilliant, but the quality of the personality is subject to opinion - as I mentioned, I did not personally enjoy the agreeability of the bot. What's toxic today may not be toxic tomorrow and vice versa.

It's just a matter of time before a model of this size can be run on commodity hardware and somebody will take the brakes off and/or attempt to run experiments that aren't just "can this thing pass the turing test?". I'd be really interested to know the thoughts of the team, given their expert knowledge and experience with the matter.

Re: Facebook uses 1.5B Reddit posts to create chatbot

#110

Post by phreeza »

robmccoll wrote: post #97
pesenti wrote: post #86

Earlier quoted context omitted.

That's definitely a fair concern. We believe that open science and transparency are the right approach here. By releasing it, we ensure that everyone is on the same page with respect to abilities and defense.

> By releasing it, we ensure that everyone is on the same page with respect to abilities and defense. This seems like wishful thinking. Having knowledge and having the resources to do something with it are two very different things.

Defending against such an "attack" is much easier if the technology is widely available and many people can play around with it and explore the limits.
Post reply on HN