Earlier quoted context omitted.
GPT-2 Here is one cool (and recent) research project using GPT-2 model weights. https://www.lesswrong.com/posts/cgqh99SHsCv3jJYDS/we-found-a...
TFA claims GPT-2 isn't open. Is it that the trained weights are open but the project that did the training isn't?
How 'Open' Is OpenAI, Really?
71–78 of 78 posts
Re: How 'Open' Is OpenAI, Really?
#72Now that it runs on our laptops a lot of the initial shock, mystique, and novelty has already worn off, just like with DALL-E before it. What the leaks show is that the community can run circles around OpenAI and the others when it comes to optimizing these things and taking them in interesting directions on a shoe string budget. For example of what one sesh of tinkering can produce: https://github.com/geohot/tinygra…
ChatGPT can run on our laptops? How? The only thing I could find was that it can't because it requires 128 GB VRAM.
Re: How 'Open' Is OpenAI, Really?
#73I thought it was so cool how a non-profit made one of the most game changing tech products in years. Then I was incredibly bummed when I realized they weren't a non profit anymore.
They are still dedicated towards trying to advance humanity and I think that's more important than non-profit status. (For the record, I'm uncertain whether they are net positive or not given that I am skeptical of their approach to safety).
Re: How 'Open' Is OpenAI, Really?
#74on the meaning of open, a tangential issue, let's have Sherman set the wayback machine to when the word "open" first started being used. "OK Mr Peabody" open has a number of meanings that are useful, but have been overwhelmed by the concept of open source. but open standards used to be the meaning. "ethernet is this, here's how you talk to it, but we're not going to write the code for you" (i'm not claiming that ethe…
> open has a number of meanings that are useful, but have been overwhelmed by the concept of open source. How is Open Source not open? You have the source, and it is open (you can modify, hack, and distribute it). Hence, “Open Source”. What’s wrong with it? > but open standards used to be the meaning. "ethernet is this, here's how you talk to it, but we're not going to write the code for you" (i'm not claiming that e…
I didn't say open standards are better than open source, I said open standards are also open.
don't have time to read the rest of your comment, chatgpt's waiting for me on hold and getting impatient.
Re: How 'Open' Is OpenAI, Really?
#75Re: How 'Open' Is OpenAI, Really?
#76Openai changed it course. Time for rebranding! ClosedAI? MicrosoftAI? What do you think it should be?
I actually think that open source AI will be a terrible idea for sufficiently advance AI for the same reasons that open source nukes or bioweapons would be a mistake. So I'd be very happy to see them change their name to ClosedAI.
Re: How 'Open' Is OpenAI, Really?
#77Openai changed it course. Time for rebranding! ClosedAI? MicrosoftAI? What do you think it should be?
Re: How 'Open' Is OpenAI, Really?
#78Openai changed it course. Time for rebranding! ClosedAI? MicrosoftAI? What do you think it should be?
They should go old school and call it Clippy. That would be amazing.