> The Meena model has 2.6 billion parameters and is trained on 341 GB of text, filtered from public domain social media conversation
Who's conversations?
Towards a conversational agent that can chat about anything
11–20 of 108 posts
Re: Towards a conversational agent that can chat about anything
#12Let us talk to it!
Re: Towards a conversational agent that can chat about anything
#13>Also, tackling safety and bias in the models is a key focus area for us, and given the challenges related to this, we are not currently releasing an external research demo.
Read: We don't want the internet to turn our program into Tay 2.0 because we are super duper serious.
I get why these companies do this. But I can't help but feel like attempting to eliminate "bias" and tackle "safety" are counter productive to the goal of developing softwate desinged to mimic a species that is by and large biased and unsafe. Purposefully hindering a program because you're afraid it might produce results is not a healthy method of development, especially in an area like AI where we are still working to understand the basics of the field. Let the programs "learn" what's objective before trying to constrain it with the subjective.
Re: Towards a conversational agent that can chat about anything
#14Cool, how do I talk to it? I see these big announcements with nothing behind them but a white paper and no way to reproduce. It's not a fact if there is no falsifiability.
To my knowledge, you can't talk to it. It looks like so far they've released sample conversations with Meena[0], and not much else. They've given a rough description of the model architecture and how they trained it, but good luck trying to replicate their 2.6B parameter model unless you can afford a lot of computes.
[0]: https://github.com/google-research/google-research/tree/mast...
Re: Towards a conversational agent that can chat about anything
#15> The Meena model has 2.6 billion parameters and is trained on 341 GB of text, filtered from public domain social media conversation Who's conversations?
Maybe Twitter? It's got a fairly conversational tone.
Re: Towards a conversational agent that can chat about anything
#16> The Meena model has 2.6 billion parameters and is trained on 341 GB of text, filtered from public domain social media conversation Who's conversations?
Good question. I think they probably meant "publicly available," not "public domain." Maybe one could make an educated guess about which platforms they took data from, based on the sample outputs of their model? I can't tell, myself.
Samples here: https://github.com/google-research/google-research/tree/mast...
Re: Towards a conversational agent that can chat about anything
#17>Also, tackling safety and bias in the models is a key focus area for us, and given the challenges related to this, we are not currently releasing an external research demo. Read: We don't want the internet to turn our program into Tay 2.0 because we are super duper serious. I get why these companies do this. But I can't help but feel like attempting to eliminate "bias" and tackle "safety" are counter productive to t…
I guess I get the bias issue (though difficult to remain neutral on some subjects.) But safety? It’s a bot. No matter what it says to me there is no way I’m going to feel unsafe. I mean ok, don’t doxx people (I hope that’s kinda default behavior though).
Re: Towards a conversational agent that can chat about anything
#18>Also, tackling safety and bias in the models is a key focus area for us, and given the challenges related to this, we are not currently releasing an external research demo. Read: We don't want the internet to turn our program into Tay 2.0 because we are super duper serious. I get why these companies do this. But I can't help but feel like attempting to eliminate "bias" and tackle "safety" are counter productive to t…
I guess I get the bias issue (though difficult to remain neutral on some subjects.) But safety? It’s a bot. No matter what it says to me there is no way I’m going to feel unsafe. I mean ok, don’t doxx people (I hope that’s kinda default behavior though).
[deleted]
Re: Towards a conversational agent that can chat about anything
#19>Also, tackling safety and bias in the models is a key focus area for us, and given the challenges related to this, we are not currently releasing an external research demo. Read: We don't want the internet to turn our program into Tay 2.0 because we are super duper serious. I get why these companies do this. But I can't help but feel like attempting to eliminate "bias" and tackle "safety" are counter productive to t…
I guess I get the bias issue (though difficult to remain neutral on some subjects.) But safety? It’s a bot. No matter what it says to me there is no way I’m going to feel unsafe. I mean ok, don’t doxx people (I hope that’s kinda default behavior though).
"Our bot keeps asking for us to connect it to the internet and suggests that it'll be able to learn faster that way. We're really excited about this development, but a good fraction of our developers have started running around screaming about the apocalypse, so we're postponing public release until the chatbot tells us how to calm them down"
Re: Towards a conversational agent that can chat about anything
#20> The Meena model has 2.6 billion parameters and is trained on 341 GB of text, filtered from public domain social media conversation Who's conversations?
If typing random letters into Google translate taught me anything. Emails and anything stored in the Google cloud or device.