Live data from Hacker News

Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model

talktotransformer.com

21–30 of 93 posts

Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model

#21
post #3

What hardware are you using for this?

A quick guess - a standard server instance. It's hosted on what looks like a Digital Ocean IP, and Digital Ocean doesn't have GPU instances AFAIK; and generation is very slow, much slower than I'd expect from GPU. So this might be running on CPU, which would save a ton of money.

I would be stoked to have some GPU resources from DO. I would like to play around with this kind of stuff on DO for a few days and then destroy the droplet. I have done it a few times with other OpenAI projects using CPU. It was pretty cool to see Ai play all the games in the gym. That is all, the end

Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model

#22
Built by Adam King (@AdamDanielKing) as an easier way to play with OpenAI's new machine learning model. In February, OpenAI unveiled a language model called GPT-2 that generates coherent paragraphs of text one word at a time. The model is extremely useful to quickly generate meaningful sentences, but King made an incredibly elegant alternative with GPT-1 - the same technique he uses in his original game.

(The original, non-Pillowwordly version uses a combination of the words, "stupid," and "cunning." The most powerful version, which uses only the original words, produces sentences with "I'm pretty smart." As long as you remember to replace stupid with cunning - and remember to replace cunning with stupid - this will be a very easy puzzle for you, and it'll be just as satisfying, if not more so, if you're more experienced by learning GPT-1 instead. I suggest you give this tutorial a try and give us a share in the profits if you find it useful, then share the tutorial link with your friends and fellow Googlers!)

This is the same system we use to generate this piece of music, and it works even better. Our goal is to predict a song's exact words and phrases from scratch. We used a similar system in the original game. We used GPT-1 to generate words and phrases for the song, and then our words and phrases were randomly generated based on their meaning in OpenAI's language model. To put this in more understandable terms, to give you an example, we've used a phrase we've previously called "dude. I can see him doing that..." -

Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model

#23

Wow, this is good. I gave it "Configure your pipeline state object with a compute shader that consumes uniforms and vertex buffers." and it came up with this: Note that the compiler will add a compute shader at compile time and require you to configure your pipeline state every time. This is the equivalent on a more traditional GPU where shader compilation occurs between the GPU and CPU. For example if you want to se…

> It's a very compelling illusion of actually understanding the topic. I've seen less coherent responses on Stack Overflow and, dare I say it, Hacker News.

I think you've highlighted a very interesting angle. A lot of writings by users on the internet have common grammar mistakes or more like, the apathy towards adhering to correct English grammar.

After arguing and correcting people on the Internets for the past 20 years, the semantics became more urgent than the syntax, and as a result, I often read my own writing in aghast-the realization that when people write tl;dr they really meant it-because as soon as you hit submit the original meaning is lost and with our limited cognitive resources we choose to filter out only what we want to read and ignore the rest.

The true test for this sort of text transformer will be to generate an equally incorrect syntax and idiosyncrasy through writing style and skew towards the use of specific group of vocabulary (ab)used by the author, meaning an entire Reddit drama thread generated purely by AIs, complete with trolling, argument traps, and generalization, the complete toolbox of an Internet keyboard warrior.

edit: I finally got a response back from the generator: I typed 'lick my butt' and the result is shockingly good-its everything I'd expect from someone who would start off with that phrase: lick my butt. I don't know what kind of ass you got. I'll just crawl next to you. I'll crawl next to you like this, so that if you get a little pissed, you have time to take it easy and go back to enjoying the show. Don't make me go back to enjoying the show. You can go back to enjoying the show. You can walk with me. You can take me. You can crawl next to me. Don't go. It's okay. I'm just making you comfortable again. And, I don't want you to leave. And, it's fine. I'll let you keep my body. You can take me but don't keep me. I don't need you to keep me.

That's just the opening I mentioned from when she says goodbye and leaves him for it. It has been a while since I have been "comforted;" and not comfortable in a nice way. He's gone over her body in a way that just takes her from me, into my body again; but, doesn't take her any further. She continues to leave behind me that way, but we both know that this isn't just about me anymore. It's about her.

I don't know what to say to her at this point. As much as I want to go over what I experienced with her last time, I can't just let this go. After all, this wasn't a last-minute fuck because I couldn't come. It wasn't because he wasn't enjoying himself. It was because he has a girlfriend; and, he feels that she deserves to be comforted. (The way he says that doesn't work either; it's one thing if he needs me to be comforted, but it's another to tell her he wanted her too and he just needed time to enjoy himself. She deserves to be comforted too; after all, he is getting older and older.

Especially that line 'last-minute fuck because I couldn't come' is completely in line with the overall tone of the generated text. You would think this post was written by a 20 something red pill poster.

Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model

#24
Oh wow, the newer model is so much better!

If anyone is interested, I have a repo for using it as a discord bot [0].

I didn't know that openAI released a newer larger version though, good to know!

[0]: https://github.com/itsmehemant123/gpt2-discord-bot

Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model

#25
I went to cinema with two friends tonight. The completion was something like we saw The Phantom Menace on TV, and Sully the time before.

Definitely this model doesn't understand the world. I wonder if multiple layers of neural networks will do. Maybe that's how our brain works, not with a single model, no matter how large.

Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model

#26
This was the result of a prompt consisting of a single chicken leg emoji:

Offline

Activity: 1234

Merit: 1000

LegendaryActivity: 1234Merit: 1000 Re: BCH vs XCM - How to decide September 28, 2010, 02:17:45 PM #18 You don't know anything about BCH or XBC. Do you have something that you know that isn't what the majority of miners are thinking? I'm not aware of anything that you haven't heard about before in the Bitcoin world. I don't think some people think that it is more secure than any other alternative. Is there someone who knows more than you do about these currencies?

Quote The question of how we decide should also be debated. If we don't give a single vote on the block size limits, or the BCH and XBC proposals at least, there is no room for compromise. If I am a developer of an alt chain and someone gives me permission, I will work for it. If I am an alt chain developer and this user or group says "no" then I will support them. This allows developers to have different options if all the other devs, and even some developers who think it isn't worth working with the alt chain company, have some different opinions because there's a different way a transaction or code should be built that supports the idea of the alt chain.

Quote Can we stop saying this: "Bitcoin is secure"?

Well that's because in our vision, the future blockchain uses decentralized software, but the current software currently works for all purposes. So it's an experiment. At this point, it would be wise to get a better understanding of what you are trying to achieve. For example, if you want a more secure block chain, then how to achieve

Re: Show HN: Talk to Transformer – Generate Text with OpenAI's Latest GPT-2 Model

#30

Completing this actionable guide will require significant effort on your end, but just remember: validation dollars are infinitely cheaper than development dollars. And you don’t have to complete this guide in one sitting, so don’t be intimidated. So that's it! This guide gives you a complete overview of building a reusable business logic framework. To get a very comprehensive overview of this topic, see this article…

After "Completing". lame
Post reply on HN