Live data from Hacker News

How 'Open' Is OpenAI, Really?

dot.la

71–78 of 78 posts

Re: How 'Open' Is OpenAI, Really?

#71
post #19

Earlier quoted context omitted.

GPT-2 Here is one cool (and recent) research project using GPT-2 model weights. https://www.lesswrong.com/posts/cgqh99SHsCv3jJYDS/we-found-a...

TFA claims GPT-2 isn't open. Is it that the trained weights are open but the project that did the training isn't?

Realistically the most difficult part of training a LLM is curating a good data set. OpenAI never published their training data.

Re: How 'Open' Is OpenAI, Really?

#72
post #32

Now that it runs on our laptops a lot of the initial shock, mystique, and novelty has already worn off, just like with DALL-E before it. What the leaks show is that the community can run circles around OpenAI and the others when it comes to optimizing these things and taking them in interesting directions on a shoe string budget. For example of what one sesh of tinkering can produce: https://github.com/geohot/tinygra…

ChatGPT can run on our laptops? How? The only thing I could find was that it can't because it requires 128 GB VRAM.

Not ChatGPT, but LLaMa. Not as good as ChatGPT, but seeing the pace of progress when performance has been demonstrated, we'll have ChatGPT running on our laptops by summer. End of the year at the latest.

Re: How 'Open' Is OpenAI, Really?

#73
post #5

I thought it was so cool how a non-profit made one of the most game changing tech products in years. Then I was incredibly bummed when I realized they weren't a non profit anymore.

They are still dedicated towards trying to advance humanity and I think that's more important than non-profit status. (For the record, I'm uncertain whether they are net positive or not given that I am skeptical of their approach to safety).

Im skeptical of their dedication towards trying to advance humanity versus more mundane objectives. It's a tale as old as time that noble initial goals are corrupted by power and greed when opportunity presents itself.

Re: How 'Open' Is OpenAI, Really?

#74
post #28

on the meaning of open, a tangential issue, let's have Sherman set the wayback machine to when the word "open" first started being used. "OK Mr Peabody" open has a number of meanings that are useful, but have been overwhelmed by the concept of open source. but open standards used to be the meaning. "ethernet is this, here's how you talk to it, but we're not going to write the code for you" (i'm not claiming that ethe…

> open has a number of meanings that are useful, but have been overwhelmed by the concept of open source. How is Open Source not open? You have the source, and it is open (you can modify, hack, and distribute it). Hence, “Open Source”. What’s wrong with it? > but open standards used to be the meaning. "ethernet is this, here's how you talk to it, but we're not going to write the code for you" (i'm not claiming that e…

i didn't say open source is not open, i said that other things that are not open-source can also be called open. OpenAI is not called OpensourceAI because that's not the extent of what they meant.

I didn't say open standards are better than open source, I said open standards are also open.

don't have time to read the rest of your comment, chatgpt's waiting for me on hold and getting impatient.

Re: How 'Open' Is OpenAI, Really?

#76

Openai changed it course. Time for rebranding! ClosedAI? MicrosoftAI? What do you think it should be?

I actually think that open source AI will be a terrible idea for sufficiently advance AI for the same reasons that open source nukes or bioweapons would be a mistake. So I'd be very happy to see them change their name to ClosedAI.

Why is that?

Re: How 'Open' Is OpenAI, Really?

#78
post #77

Openai changed it course. Time for rebranding! ClosedAI? MicrosoftAI? What do you think it should be?

They should go old school and call it Clippy. That would be amazing.

I already know many people who are calling it "Clippy", seems to be the unofficial name for it within circles I frequent ha
Post reply on HN