Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model
talktotransformer.com
Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model
1–10 of 93 posts
Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model
#2What hardware are you using for this?
Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model
#3What hardware are you using for this?
A quick guess - a standard server instance. It's hosted on what looks like a Digital Ocean IP, and Digital Ocean doesn't have GPU instances AFAIK; and generation is very slow, much slower than I'd expect from GPU. So this might be running on CPU, which would save a ton of money.
Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model
#4[deleted]
Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model
#5What hardware are you using for this?
The site was using one K80 GPU but it's slowing down significantly so I'm adding a second GPU. The servers run on Google Kubernetes Engine.
Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model
#6Wow, this is good. I gave it "Configure your pipeline state object with a compute shader that consumes uniforms and vertex buffers." and it came up with this:
Note that the compiler will add a compute shader at compile time and require you to configure your pipeline state every time. This is the equivalent on a more traditional GPU where shader compilation occurs between the GPU and CPU. For example if you want to set the shader with a single pass on a CPU it is reasonable to compile it each time after GPU rendering, and even compile it once on the GPU. This is an extension of the parallel compile-to-script: run-to-script approach.
It's a very compelling illusion of actually understanding the topic. I've seen less coherent responses on Stack Overflow and, dare I say it, Hacker News.
Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model
#7My first test showed that it's surely not perfect. I admit, after all the hype, I expected my SOCKS to be blown off.
My prompt: "If Timmy is"
Response: "If timmy is iced. then iced = iced + ( " "M " + m ) where iced ="
Hmmm.
Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model
#8[deleted]
Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model
#9Hey I'm _____, what do I do ____________?
When I was 11, my mom told me every day, "Don't say anything bad about my Dad."
I knew that was a lie, but I needed to say it anyways, so I wrote down the reasons why I wasn't nice to him. I would go to the bathroom and look back over my shoulder for a few seconds before walking around without noticing that my Mom had written down every bad thing about him on a piece of paper. I would go to school to catch up a few more papers.
:o
Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model
#10My first test showed that it's surely not perfect. I admit, after all the hype, I expected my SOCKS to be blown off. My prompt: "If Timmy is" Response: "If timmy is iced. then iced = iced + ( " "M " + m ) where iced =" Hmmm.
As far as I know, this is the hamstrung model they released due to concerns surrounding ethical usage of the full model.