11–20 of 26 posts
Conversational AI is much closer than we think. Neural sequence-to-sequence models are successful in domain specific domains. But in the context of chit-chat based dialogue systems, the responses lack humanity. Undoubtedly due to the fact they don't comprehend our world. Transfer learning alleviates some of that awkwardness. If anyone's interested in further experiments on their own. There is now a unified Python fra…
You can check it out for yourself. https://talktotransformer.com/ Pretty awesome.
"This spring, the Elon-Musk-founded AI research lab OpenAI made a splash with an AI system that generates text. It can write convincing fake reviews, fake news articles, and even poetry." You can check it out for yourself. https://talktotransformer.com/ Pretty awesome.
The bridge wasn't quite right. There were small sparks coming off the incomplete sections of material hanging just to the right of the traffic lights. Gary wasn't worried, however. He walked up carefully. "This is it, guys!"
A huge explosion rocked the bridge, and a fireball engulfed the entire bridge. "Shit! Shit!"
It seemed as though the fire was just blowing out, and the bridges were back in place. Gary was a little concerned, but it wasn't a problem at the time. At least it was under control.
He walked forward, peering over the top. "This is terrible. I'm not leaving the village tonight! How about a break for some water and a drink?"
When he looked down, the large chunk he had just taken off of the bridge was gone. As soon as he realized it was gone, he turned back to the village to check to see what had happened. Not sure what to do, he continued down the hill, heading toward the village at all times. The entire town was completely surrounded, and everyone was either inside or had
Not bad, but it's strange that it autogenerated text with multiple spaces at the end of sentences. Also, it is far more dramatic than I would have guessed.
"This spring, the Elon-Musk-founded AI research lab OpenAI made a splash with an AI system that generates text. It can write convincing fake reviews, fake news articles, and even poetry." You can check it out for yourself. https://talktotransformer.com/ Pretty awesome.
"This spring, the Elon-Musk-founded AI research lab OpenAI made a splash with an AI system that generates text. It can write convincing fake reviews, fake news articles, and even poetry." You can check it out for yourself. https://talktotransformer.com/ Pretty awesome.
For the lazy: The bridge wasn't quite right. There were small sparks coming off the incomplete sections of material hanging just to the right of the traffic lights. Gary wasn't worried, however. He walked up carefully. "This is it, guys!" A huge explosion rocked the bridge, and a fireball engulfed the entire bridge. "Shit! Shit!" It seemed as though the fire was just blowing out, and the bridges were back in place. G…
Determining an actual official government or other institutional request is going to get much harder.
As someone who spent a lot of time trying to manually code up solutions to anaphora resolution (pronoun coreference), BERT seemed like a small miracle to me. As a side comment: I love that getting training data for BERT is so cheap: any text source, and randomly remove words, target output is predicting the words removed.
>Next we shall take a moment to remember the fallen heros, without whom we would not be where we are today. I am, of course, referring to the RNNs - Recurrent Neural Networks, a concept that became almost synonymous with NLP in the deep learning field. XLNet ( https://arxiv.org/abs/1906.08237 ) is in essence a recurrent neural network, using a transformer (which is based on neural networks) which recurrently keeps co…
Also, a recent piece of interesting work [1] shows that with the right control parameters, you could still use gated RNNs, like LSTMs, for pretty good language modeling.
[1] http://www.abigailsee.com/2019/08/13/what-makes-a-good-conve...
"This spring, the Elon-Musk-founded AI research lab OpenAI made a splash with an AI system that generates text. It can write convincing fake reviews, fake news articles, and even poetry." You can check it out for yourself. https://talktotransformer.com/ Pretty awesome.
For those of you who don't know what GPT-2 is, here's the simplest & fastest way with a bit of humor: https://blog.floydhub.com/gpt2/
Conversational AI is much closer than we think. Neural sequence-to-sequence models are successful in domain specific domains. But in the context of chit-chat based dialogue systems, the responses lack humanity. Undoubtedly due to the fact they don't comprehend our world. Transfer learning alleviates some of that awkwardness. If anyone's interested in further experiments on their own. There is now a unified Python fra…
"This spring, the Elon-Musk-founded AI research lab OpenAI made a splash with an AI system that generates text. It can write convincing fake reviews, fake news articles, and even poetry." You can check it out for yourself. https://talktotransformer.com/ Pretty awesome.
Disclaimer: built it.