"This spring, the Elon-Musk-founded AI research lab OpenAI made a splash with an AI system that generates text. It can write convincing fake reviews, fake news articles, and even poetry." You can check it out for yourself. https://talktotransformer.com/ Pretty awesome.
Also https://transformer.huggingface.co Disclaimer: built it.
Natural Language Processing: The Age of Transformers
21–26 of 26 posts
Re: Natural Language Processing: The Age of Transformers
#22"This spring, the Elon-Musk-founded AI research lab OpenAI made a splash with an AI system that generates text. It can write convincing fake reviews, fake news articles, and even poetry." You can check it out for yourself. https://talktotransformer.com/ Pretty awesome.
2 researchers from the Brown university were able to reproduce the full, and never released GPT-2 model a couple of days ago. They wrote an amazing blog post and released the weights!! Here's the blog with all the details: https://medium.com/@vanya_cohen/opengpt-2-we-replicated-gpt-... For those of you who don't know what GPT-2 is, here's the simplest & fastest way with a bit of humor: https://blog.floydhub.com/gpt2/
Re: Natural Language Processing: The Age of Transformers
#23>Next we shall take a moment to remember the fallen heros, without whom we would not be where we are today. I am, of course, referring to the RNNs - Recurrent Neural Networks, a concept that became almost synonymous with NLP in the deep learning field. XLNet ( https://arxiv.org/abs/1906.08237 ) is in essence a recurrent neural network, using a transformer (which is based on neural networks) which recurrently keeps co…
Re: Natural Language Processing: The Age of Transformers
#24"This spring, the Elon-Musk-founded AI research lab OpenAI made a splash with an AI system that generates text. It can write convincing fake reviews, fake news articles, and even poetry." You can check it out for yourself. https://talktotransformer.com/ Pretty awesome.
Re: Natural Language Processing: The Age of Transformers
#25Earlier quoted context omitted.
For the lazy: The bridge wasn't quite right. There were small sparks coming off the incomplete sections of material hanging just to the right of the traffic lights. Gary wasn't worried, however. He walked up carefully. "This is it, guys!" A huge explosion rocked the bridge, and a fireball engulfed the entire bridge. "Shit! Shit!" It seemed as though the fire was just blowing out, and the bridges were back in place. G…
It's not just "not bad." It's scary. It makes enough coherent sense from sentence to sentence that I doubt my mom (missing a few marbles) would notice it doesn't make a whole lot of sense. Combine this...some official looking logos and a request for money for a fine. Determining an actual official government or other institutional request is going to get much harder.
Re: Natural Language Processing: The Age of Transformers
#26Conversational AI is much closer than we think. Neural sequence-to-sequence models are successful in domain specific domains. But in the context of chit-chat based dialogue systems, the responses lack humanity. Undoubtedly due to the fact they don't comprehend our world. Transfer learning alleviates some of that awkwardness. If anyone's interested in further experiments on their own. There is now a unified Python fra…
Really? Most of the chatbots in production are rule based systems.