Tangentially, is there any estimation of the amount of words/sentences that a kid may have heard by the time he or she learns to talk?
OpenAI releases larger GPT-2 model
41–50 of 87 posts
Re: OpenAI releases larger GPT-2 model
#42Earlier quoted context omitted.
Someone is going to invent this model sooner or later, simply because it is possible. There is not much sense in trying to stop it. We just have to adapt.
That’s not correct. What you are saying is that there is no plausible organized effort that could stop or slow the creation of signal processing models that will have pronounced negative impacts. The error is on two levels: you are using too much analogy with other technologies. And you are writing off the possibility of stopping ai when it’s still not clear that it can’t be stopped. This isn’t something that can be…
Correction: You are in a car that doesn't have any brakes.
Re: OpenAI releases larger GPT-2 model
#43Here’s a summary: we are aware of the fact that this model will harm society and we are releasing it anyway. We are fiddling around with the way it’s released in an attempt to absolve ourselves of blame while simultaneously collecting the profit in the form of a juicy acquisition. The net result of these advanced forms of signal processing will be negative. Nobody has come forward to prove that they will benefit soci…
> of a juicy acquisition
OpenAI is a non-profit. They are not looking to get acquired.
Re: OpenAI releases larger GPT-2 model
#44Oh wow, I was literally just making a toy Discord bot for GPT-2. Guess I'll update it with the bigger model. EDIT: Done! It takes about 3x longer than it did before to generate a response, so if you try it be very patient. Also, I made this in three hours so I wouldn't be surprised if it goes up in flames at some point. https://github.com/ScottPeterJohnson/gpt2-discord
I tried adding it but I get the error message "This bot is private. Only the bot owner can add it."
Oh, sorry. I forgot to mark it as public. Feel free to try again.
Re: OpenAI releases larger GPT-2 model
#45Earlier quoted context omitted.
Someone is going to invent this model sooner or later, simply because it is possible. There is not much sense in trying to stop it. We just have to adapt.
That’s not correct. What you are saying is that there is no plausible organized effort that could stop or slow the creation of signal processing models that will have pronounced negative impacts. The error is on two levels: you are using too much analogy with other technologies. And you are writing off the possibility of stopping ai when it’s still not clear that it can’t be stopped. This isn’t something that can be…
I think if you try to be less cynical about what OpenAI is doing you might even find them an ally to your perspective. Facebook throwing pocket change at an AI ethics org and Google's rather embarrassing failure at staffing an ethics panel of its own is evidence that we've got bicycle brakes on a freight train.
OpenAI suffered a ton of blowback for not just releasing the full model from the start. You can read their intitial blog post [1] looking particularly at the sections for Policy Implications and Release Strategy. I would also highly recommend you listen to Lex Fridman's podcast with Greg Brockman [2] to hear their rationale about the recent org changes at Open AI.
Obviously you can posit that everything they say is bullshit and they are only after almighty dollars. I can't prove it's not true and personally believe there is at least a kernel of truth to it, but we live in a messy world and finding imperfect allies is generally better than having none at all.
Re: OpenAI releases larger GPT-2 model
#46Earlier quoted context omitted.
Someone is going to invent this model sooner or later, simply because it is possible. There is not much sense in trying to stop it. We just have to adapt.
That’s not correct. What you are saying is that there is no plausible organized effort that could stop or slow the creation of signal processing models that will have pronounced negative impacts. The error is on two levels: you are using too much analogy with other technologies. And you are writing off the possibility of stopping ai when it’s still not clear that it can’t be stopped. This isn’t something that can be…
What do you mean "Could we sense when someone was trying to do it", are we talking mandatory computer inspections, government-enforced walled gardens, and the death of the general purpose computer? lol, if you thought gun control was hard...
Also, yeah, you could do it in your basement without being detected.
You can do it in the cloud, too, a lot of us here have the skills and resources to do it, but why spend time on this toy instead of another one, especially if it's going to cost money we could spend on something more fun?
Re: OpenAI releases larger GPT-2 model
#47Maybe I’m too naive here, but I’m not seeing the potential malicious usage of this model. People will generate text, and then what?
Re: OpenAI releases larger GPT-2 model
#48Here’s a summary: we are aware of the fact that this model will harm society and we are releasing it anyway. We are fiddling around with the way it’s released in an attempt to absolve ourselves of blame while simultaneously collecting the profit in the form of a juicy acquisition. The net result of these advanced forms of signal processing will be negative. Nobody has come forward to prove that they will benefit soci…
> of a juicy acquisition OpenAI is a non-profit. They are not looking to get acquired.
Is it still a non-profit? I think they changed their structure to some fudged thing recently.
Re: OpenAI releases larger GPT-2 model
#49Maybe I’m too naive here, but I’m not seeing the potential malicious usage of this model. People will generate text, and then what?
Fiction, but this might be a good place to start: https://slatestarcodex.com/2018/10/30/sort-by-controversial/
Re: OpenAI releases larger GPT-2 model
#50Maybe I’m too naive here, but I’m not seeing the potential malicious usage of this model. People will generate text, and then what?
It will accelerate the development of a fact checking AI, which means lying and manipulating people won't be so profitable any more, I guess.