Earlier quoted context omitted.
ChatGPT can run on our laptops? How? The only thing I could find was that it can't because it requires 128 GB VRAM.
https://github.com/ggerganov/llama.cpp/issues/39 40GB for the big llama.
But that's not ChatGPT?
How 'Open' Is OpenAI, Really?
41–50 of 78 posts
Re: How 'Open' Is OpenAI, Really?
#42on the meaning of open, a tangential issue, let's have Sherman set the wayback machine to when the word "open" first started being used. "OK Mr Peabody" open has a number of meanings that are useful, but have been overwhelmed by the concept of open source. but open standards used to be the meaning. "ethernet is this, here's how you talk to it, but we're not going to write the code for you" (i'm not claiming that ethe…
> open has a number of meanings that are useful, but have been overwhelmed by the concept of open source.
How is Open Source not open? You have the source, and it is open (you can modify, hack, and distribute it). Hence, “Open Source”. What’s wrong with it?
> but open standards used to be the meaning. "ethernet is this, here's how you talk to it, but we're not going to write the code for you" (i'm not claiming that ethernet was originally an open standard, just using that as an example of what an open standard means)
Open standards are not better than Open Source, if you go that way. Most of them are not free, for a start.
> and hardware manufacturers used to include blueprints/schematics (for repair, or for interconnection, for example) and commercial software vendors would show you the source code, snip
That is a fantasised past. Some companies did; most companies did not. Just as nowadays.
Re: How 'Open' Is OpenAI, Really?
#43Does it matter? Openai finally built something resembling ai. Big tech wasn’t innovating, I personally don’t care if employees at openai capture a ton of the upside
> Does it matter?
It does. Very much. We do not want to have to rely on government intervention and unforced errors to avoid an AI wasteland like we used to have with operating systems and web browsers. Particularly as these things are trained using our collective “wisdom” (well, production anyway) only to be sold back to us.
Re: How 'Open' Is OpenAI, Really?
#44Re: How 'Open' Is OpenAI, Really?
#45Does it matter? Openai finally built something resembling ai. Big tech wasn’t innovating, I personally don’t care if employees at openai capture a ton of the upside
> Does it matter? Yes. > Openai finally built something resembling ai. Big tech wasn’t innovating, I personally don’t care if employees at openai capture a ton of the upside And if they called themselves ClosedAI I don't think people would mind so much; it's the dishonesty that's grating.
> And if they called themselves ClosedAI I don't think people would mind so much; it's the dishonesty that's grating.
Isn’t this part for the course for an Elon project? Jokes aside (in this case I actually agree with him that openness is critical if the society starts really relying on AI), there would still be a need for a free model. There is too much at stake to rely on a single black box in that area.
Re: How 'Open' Is OpenAI, Really?
#46Earlier quoted context omitted.
I hope they eventually give the word Open another meaning, for example, they can make their technology and method more open (source, maybe), and/or create a standardized platform to allow people to freely play with and extent their technology without the fear of big daddy restriction. On the other hand, if they ended up chooses a different route, go patented everything and starts suing, then maybe it's better off for…
I hope their api pricing goes down over time.
It depends on how many competitors will enter the market. At current stage, I would say the chance of them to increase the price is high. The current price is so cheap, it might as well work for a saturated market, which is not what the actual market is currently at.
I guess their current pricing is designed to attract new users to bring use cases/ideas to them, which would be a field where their the imagination is lacking.
Re: How 'Open' Is OpenAI, Really?
#47Now that it runs on our laptops a lot of the initial shock, mystique, and novelty has already worn off, just like with DALL-E before it. What the leaks show is that the community can run circles around OpenAI and the others when it comes to optimizing these things and taking them in interesting directions on a shoe string budget. For example of what one sesh of tinkering can produce: https://github.com/geohot/tinygra…
ChatGPT can run on our laptops? How? The only thing I could find was that it can't because it requires 128 GB VRAM.
LLaMa [1] works on Apple Mx processors due to unified memory. The 7B model works on a 8GB Apple MacBook Pro M1, ~40 seconds/token.
[1] https://dev.l1x.be/posts/2023/03/12/using-llama-with-m1-mac
Re: How 'Open' Is OpenAI, Really?
#48AAAS (AI as a Service)
You heard it here first.
Re: How 'Open' Is OpenAI, Really?
#49Openai changed it course. Time for rebranding! ClosedAI? MicrosoftAI? What do you think it should be?
command.com
Re: How 'Open' Is OpenAI, Really?
#50Earlier quoted context omitted.
https://github.com/ggerganov/llama.cpp/issues/39 40GB for the big llama.
But that's not ChatGPT?
Not it isn't but what the OP is saying that with the llama models (and others) being runable on consumer hardware it's only a matter of time until we get something that's "good enough" for many use cases.
Maybe not first of the class but there is a lot value to be found in the middle ground and it's good for the market as a whole.