Live data from Hacker News

OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak

futurism.com

141–150 of 201 posts

Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak

#141

Earlier quoted context omitted.

And while we're doing that touch vs. tactile comparison, what I also loved about the old "dumb phones" was deterministic timing . I could do stuff on those phones from start to end without looking at the screen - I quickly learned and remembered that e.g. this operation completed instantly, and that menu has ~1/4 of loading time, etc. I think this feature was actually key to being able to memorize how to perform oper…

I am really hoping that we reach peak touchscreen soon, and companies can start exploring other form factors again. I want a fast CPU and wifi in something that isn't just a giant flat slab of glass.

Haven't we already?

Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak

#142
post #136

Earlier quoted context omitted.

Welcome to IRC. Anyways, i could see someone use that term in frustration about a car having been parked across two spaces.

I assumed it was a reference to domain parking/squatting.

I guess i got the alternate impression because i read the original Swedish article text...

Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak

#143

Earlier quoted context omitted.

> I've applied for a grant from NVidia so I can fix that. A g2.xlarge is 65c/hour on AWS, FWIW. https://aws.amazon.com/ec2/pricing/on-demand/

That's honestly no way to get anything done... Unless you're replicating someone else's thing exactly , You can't really get by with one training process. You want to be trying different things, and running a few samples of each configuration to account for random variation. I'm not even talking about decadent hyper-parameter sweeps to fine-tune. I'm talking like, how wide do I need my layers to be, what optimizers a…

Sorry, I had the impression from the GP that you were trying to replicate a CPU-based task on a GPU.

Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak

#144
post #122

Earlier quoted context omitted.

Spot instances are pretty painful for training. It's annoying to have the machine randomly shut down.

^ That. For all that people say about spot instances, there's no infrastructure I know if to manage jobs and have them migrate to higher priced instances without losing state.

You can always snapshot and keep track of state as you go (a little bit tricky with Spark, though). We use spot instances for training we know is not vital (as in, has to be done, but rather run it twice and save money anyway that run it for sure). Also, once you know what availability specific instances have you can always choose better (i.e. maybe c3.xlarge is slightly more expensive as spot than large, you can do with large... but xlarge has almost no shutdowns)

Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak

#145
post #74

Earlier quoted context omitted.

Build a household AI, like JARVIS from Iron Man. Edit: Corrected.

Yup, this is my answer. I'm slowly building an in-house software suite .. because i can, i guess, and a big thing i'm wanting is to tie it all together with a human friendly administrative program. The main thing stopping me is NLP. Ideally, i want this offline only as i am unsure how much of my life i want to leave my home network.

You can use PocketSphinx to turn voice into text with a little training... and then Tensorflow that text into a set of commands.

Easy peasy. (Not really, but for an in-home piece of software, it doesn't seem too bad.)

Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak

#146
post #5

How one would use such technology? Let me rephrase - how would YOU use this technology if you had it? Imagine you have a bot that convincingly passes the Turing test - what would you do with it? Build a chatbot business? B2C or B2B? Sell it to one of the big companies and if yes then how much do you think it would go for? Give it to OpenAI? Open source it? If you answer yes to any of this questions, then why? Edit: l…

I'm going to make a prediction: Soon after the first chatbot passes a Turing Test, there will be many more to follow, they will get better and better, and the methods will be so interlinked that there will be no way to defend it as proprietary software. The data too will be open source--the public reddit dataset already has tons of value in it. The question then is, "When everyone has access to free chatbots that can…

Turing test is relatively easy to pass if you creatively design your program to roleplay an irrational character. See this program https://en.wikipedia.org/wiki/Eugene_Goostman

Obviously such programs, while being works of art, are not interesting from AI/Machine Learning point of view.

Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak

#147
Instead of the Reddit corpus you may just as well use a picture library of human footprints. It would be no more optimistic.

Human speech is produced from the conscious experience of being a human being. If your dataset contains just the speech, without the experience, there's simply not enough there. Any machine trained on this data is doomed to talk hollow rubbish.

Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak

#148
post #5

How one would use such technology? Let me rephrase - how would YOU use this technology if you had it? Imagine you have a bot that convincingly passes the Turing test - what would you do with it? Build a chatbot business? B2C or B2B? Sell it to one of the big companies and if yes then how much do you think it would go for? Give it to OpenAI? Open source it? If you answer yes to any of this questions, then why? Edit: l…

I'm going to make a prediction: Soon after the first chatbot passes a Turing Test, there will be many more to follow, they will get better and better, and the methods will be so interlinked that there will be no way to defend it as proprietary software. The data too will be open source--the public reddit dataset already has tons of value in it. The question then is, "When everyone has access to free chatbots that can…

Woah! I thought they pretty much already have passed it? Remember Ashley Madison? You had ~12 million heterosexual men (that were cheaters, 6 million 'active' users) trying to talk to ~12k heterosexual women (also cheaters, 10k 'active' accounts). It ends up being about a 1:13,000 ratio. Not only that but MANY of these men had paid actual real money to the site in order to do so, and then continued to do so. The only real conclusion was that most of the men were talking to bots that the site had made up.

Ok, lets get this straight: ~6 million real human men paid real money that they earned through their labor or whatever to talk to bots and then paid more real money to do it again. Admittedly, they are 'cheaters', but 6 million men must have an IQ distribution nearly identical to that of the general population, i.e. they represent heterosexual human males in general. And yes, they were trying to get laid, these conversations are likely pretty brief, and mammalian males are not generally known for using their neocortex during mating.

Still, I think that 'counts' as far as passing the Turing Test. Yes, now we can move the goal posts to say that the bot has to teach me something, or guess what I was thinking, or generally be better than a man on tinder. But as a first pass of the TT, I think we have been here for a few years now.

https://en.wikipedia.org/wiki/Ashley_Madison_data_breach

Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak

#149
Let's not kid ourselves. The technology will be used by PR firms, advertising companies, political campaigns and governments to pretend, at scale, that there is public consensus on certain issues and to drown social media conversation in particular narratives.

Anyone have any good defensive technology ideas?

Re: OpenAI is Using Reddit to Teach An Artificial Intelligence How to Speak

#150
post #5

How one would use such technology? Let me rephrase - how would YOU use this technology if you had it? Imagine you have a bot that convincingly passes the Turing test - what would you do with it? Build a chatbot business? B2C or B2B? Sell it to one of the big companies and if yes then how much do you think it would go for? Give it to OpenAI? Open source it? If you answer yes to any of this questions, then why? Edit: l…

I would use it as a tool in a very convincing and powerful propaganda toolbox.
Post reply on HN