Live data from Hacker News

Towards a conversational agent that can chat about anything

ai.googleblog.com

51–60 of 108 posts

Re: Towards a conversational agent that can chat about anything

#51
post #42

I would really like a bot that could summarize topics for me then drill down into specifics based on questions I had. Even if it was all just from the Wikipedia page. This would be so nice to triage information while driving.

Actually just ran into this [1] today. Not production ready, but you could hack something together with it. It was even trained on Wikipedia articles.

[1]: https://rajpurkar.github.io/SQuAD-explorer/

Re: Towards a conversational agent that can chat about anything

#52

From the very first sample conversation they released: - Human: Hi! - Meena: Hey there! What's up? - Human: Same old, Monday blues...what are you up to? - Meena: I'm procrastinating on a paper I'm supposed to be writing. - Human: are you thinking of pulling an all nighter? - Meena: Possibly. What's your paper on? The bot has already mistaken facts about its own crafted persona and the human in less than 2 meaningful…

these nlp models are getting better and better but what we need ofc is for some model of the world to be constructed during the speech. If I tell you that yesterday I accidentally knocked a glass of water off the table and it fell on to soft carpet you could guess that it survived the fall without shattering. What we need is a chatbot that as you talk to it can update a 3d game/physics engine model from your words so…

This might sound unrealistically complicated, and the approach suggested here certainly is, but the idea of simulating a world is a very important concept in our current models of human intelligence, with very small children spending a lot of their time learning basic concepts of cause and effect, properties of objects, materials and physics and so on.

It reminds me of something I do in my current occupation, with a robot. It makes predictions about how a certain motor movement will result in a change in position, then measures progress in the real world. Should the prediction and reality diverge significantly (more than a particular amount), it stops and calls a human to look into what happened. I can imagine AI techniques using this kind of thing to guess what will happen next in a series of events, with the result's divergance from the guess weighting the learning rather than a steadily decreasing weight. Perhaps this is already a thing though, I'm no AI researcher

Re: Towards a conversational agent that can chat about anything

#53
post #43
post #42

I would really like a bot that could summarize topics for me then drill down into specifics based on questions I had. Even if it was all just from the Wikipedia page. This would be so nice to triage information while driving.

i've thought of this many times. "Wikibot, tell me more about bridges of the 19th century." "Stop. Tell me more the Ponte delle Catene, Bagni di Lucca bridge"

Even simpler, I wanted my iPhone to read a wikipage out loud to me while I was walking home in the cold, and I was surprised that I couldn't figure it out - you can switch on the screen reader in accessibility, but it stopped reading after half a paragraph. Very annoying.

Re: Towards a conversational agent that can chat about anything

#54
post #13

>Also, tackling safety and bias in the models is a key focus area for us, and given the challenges related to this, we are not currently releasing an external research demo. Read: We don't want the internet to turn our program into Tay 2.0 because we are super duper serious. I get why these companies do this. But I can't help but feel like attempting to eliminate "bias" and tackle "safety" are counter productive to t…

> we are not currently releasing an external research demo.

Without an external research demo this is all just hype. It is pretty easy for your bot team to come up with and release conversation where your bot does really well. Having it work in the real world outside the research lab is the big issue.

Re: Towards a conversational agent that can chat about anything

#55
post #13

>Also, tackling safety and bias in the models is a key focus area for us, and given the challenges related to this, we are not currently releasing an external research demo. Read: We don't want the internet to turn our program into Tay 2.0 because we are super duper serious. I get why these companies do this. But I can't help but feel like attempting to eliminate "bias" and tackle "safety" are counter productive to t…

These measures don’t seem to be too onerous, certainly less than what a government might come up with after the first Desaster following your approach.

But it seems that’s not your most salient concern here, considering the scarequotes around „bias“, and the reversion of objective nd subjective you introduce.

Re: Towards a conversational agent that can chat about anything

#56
post #26
post #24

Earlier quoted context omitted.

Maybe not you, but explicitly encouraging others to take harmful steps is a potential outcome. For example, there's a clear safety issue with a conversational bot that tells you to kill yourself if you talk to it about feeling suicidal or depressed. What if you talk to it about immigration and by picking commonly upvoted statements on certain online communities it starts to encourage violence? There are clear ways to…

That’s a decent argument but then should we go to Hollywood and sanitize their violence in their movies (even those wanting to teach us about the evil of violence) for fear they might incite the wrong people who see such as calls to violence? What I mean is that that possibility exists in other media yet we don’t feel ambiguous about it.

People absolutely do alter their output based on how they think others may act, Hollywood is a prime example where this happens because films even get age ratings. It's more extreme really because it's outside agencies and governments putting the pressure on what is deemed allowable.

What we're talking about here isn't someone stopping others from releasing a bot but stopping themselves until they're happy with the potential risks.

Re: Towards a conversational agent that can chat about anything

#57
post #40
post #37

Earlier quoted context omitted.

First of all, Hollywood does occasionally sanitize films and TV shows. For example, the suicide scene was removed from "13 Reasons Why" after concerns from mental health experts that it might inspire copycats [1]. But even ignoring that, I think most people have a good understanding of what a movie is and that fictional characters are not real. Movies have been around for a long time, most people have been watching t…

So you’re saying people can tell fiction from reality in film (even if film re-enacts actual events), but can’t use that same construct to evaluate a “bot”? Maybe... but it seems like a bit of a stretch.

People feel sad when their bomb disposal robots die. https://www.theatlantic.com/technology/archive/2013/09/funer...

We're just not great at keeping what we know and how we feel in line.

Re: Towards a conversational agent that can chat about anything

#58
post #13

>Also, tackling safety and bias in the models is a key focus area for us, and given the challenges related to this, we are not currently releasing an external research demo. Read: We don't want the internet to turn our program into Tay 2.0 because we are super duper serious. I get why these companies do this. But I can't help but feel like attempting to eliminate "bias" and tackle "safety" are counter productive to t…

I'm glad you mentioned Tay.

When I need a laugh, I just read about Tay running amok:

https://www.theverge.com/2016/3/24/11297050/tay-microsoft-ch...

https://en.wikipedia.org/wiki/Tay_(bot)

Re: Towards a conversational agent that can chat about anything

#59

From the very first sample conversation they released: - Human: Hi! - Meena: Hey there! What's up? - Human: Same old, Monday blues...what are you up to? - Meena: I'm procrastinating on a paper I'm supposed to be writing. - Human: are you thinking of pulling an all nighter? - Meena: Possibly. What's your paper on? The bot has already mistaken facts about its own crafted persona and the human in less than 2 meaningful…

these nlp models are getting better and better but what we need ofc is for some model of the world to be constructed during the speech. If I tell you that yesterday I accidentally knocked a glass of water off the table and it fell on to soft carpet you could guess that it survived the fall without shattering. What we need is a chatbot that as you talk to it can update a 3d game/physics engine model from your words so…

You definitely need a model of the world, but you probably don't want to be constructing it during speech. What you want is a generative model that you've trained on the simulation data ahead of time so you can quickly make inferences once deployed.

Re: Towards a conversational agent that can chat about anything

#60

Earlier quoted context omitted.

these nlp models are getting better and better but what we need ofc is for some model of the world to be constructed during the speech. If I tell you that yesterday I accidentally knocked a glass of water off the table and it fell on to soft carpet you could guess that it survived the fall without shattering. What we need is a chatbot that as you talk to it can update a 3d game/physics engine model from your words so…

This might sound unrealistically complicated, and the approach suggested here certainly is, but the idea of simulating a world is a very important concept in our current models of human intelligence, with very small children spending a lot of their time learning basic concepts of cause and effect, properties of objects, materials and physics and so on. It reminds me of something I do in my current occupation, with a…

[deleted]
Post reply on HN