OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak
1–10 of 201 posts
Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak
#2The DGX-1 is available for a cool $129k: http://www.nvidia.com/object/deep-learning-system.html
Correct me if I'm wrong, but I think it's basically a couple hundred NVIDIA 10-series cards strapped together with a full custom NVIDIA software stack.
Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak
#3This will be interesting. I'm sure they are, but I hope they'll be training the system on tone and sentiment alongside syntax.
Reddit can get vitriolic and rude, insightful at times too, but once the system learns the syntax hopefully they'll be able to use sentiment analysis to weigh more strongly the polite conversion that occurs.
Also interested to see how many memes this AI picks up.
I also hope they are able to follow links through to sources when a comment cites another page -- not only can this bot learn syntax but also data extraction by comparing what is said to the source material.
Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak
#4Didn't msft do the same thing with twitter and end up with racist bot? I am not sure how this will turn out.
Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak
#5How one would use such technology? Let me rephrase - how would YOU use this technology if you had it?
Imagine you have a bot that convincingly passes the Turing test - what would you do with it?
Build a chatbot business? B2C or B2B?
Sell it to one of the big companies and if yes then how much do you think it would go for?
Give it to OpenAI? Open source it? If you answer yes to any of this questions, then why?
Edit: let me qualify - this would not be AGI, just a much more advanced bot than whatever is currently on the market.
Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak
#6The Reddit comment corpus is an awesome dataset. There's relatively little mark-up to scrub out, low duplication, good metadata, and a variety of topics.
We used it to train a syntax-enriched word2vec model. Write up and demo: https://explosion.ai/blog/sense2vec-with-spacy
Btw, the above was run on CPU in a couple of days, because spaCy doesn't use GPUs yet. I've applied for a grant from NVidia so I can fix that. If anyone from NVidia is reading, email me? :)
Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak
#7I'm looking forward to a bot making a joke about banging my mum...
Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak
#8Is it just me or does Greg Brockman speak startlingly similar to how Sam Altman speaks. Given that Sam helped start OpenAI, it wouldn't surprise me if there was some mirroring going on in the hiring process.
Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak
#9How one would use such technology? Let me rephrase - how would YOU use this technology if you had it? Imagine you have a bot that convincingly passes the Turing test - what would you do with it? Build a chatbot business? B2C or B2B? Sell it to one of the big companies and if yes then how much do you think it would go for? Give it to OpenAI? Open source it? If you answer yes to any of this questions, then why? Edit: l…
Rapidly (and with its help) get it to a point where it can self-improve beyond human intelligence.
Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak
#10Since it was not mentioned in the post, here's a direct link to the Reddit comment corpus likely being used: http://files.pushshift.io/reddit/comments/
The full table (up to end of 2015) is available on BigQuery, with separate tables for each month thereafter: https://bigquery.cloud.google.com/table/fh-bigquery:reddit_p... (there is a similar table for comments)
And here's a year-old post I wrote on how to use that Reddit dataset with BigQuery: http://minimaxir.com/2015/10/reddit-bigquery/