Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

How 'Open' Is OpenAI, Really?

dot.la

Post reply on HN
Print view View original

31–40 of 78 posts

Re: How 'Open' Is OpenAI, Really?

#31

Post by textninja »

paxys wrote: post #20
samspenc wrote: post #11

I think the article does a good job capturing the history of what happened. OpenAI started out with the intention of being a non-profit, but realized over time that it made it difficult to compete in terms of salary and hardware, so pivoted to a 'capped' for-profit. As for Microsoft, my guess is their investment was just another investment in a hot AI 'startup'. It was sheer luck, and being in the right place at the…

One reason why Microsoft was able to execute so fast was that they had nothing to lose in doing so. The entirety of the Bing product and brand is mostly immaterial to the company's bottom line. What better way to try and revitalize it than by taking a huge leap with some hot new tech that is capturing the public imagination? If that leap is successful, you get to open up a huge new line of business and challenge Goog…

How about… 3D spreadsheets, man. You finish tallying up all your credits and debits, and then wham! You’re sprung into another dimension. It’s Google Tensorsheets, man, Microsoft won’t even know what hit them.

Re: How 'Open' Is OpenAI, Really?

#32

Post by recuter »

Now that it runs on our laptops a lot of the initial shock, mystique, and novelty has already worn off, just like with DALL-E before it.

What the leaks show is that the community can run circles around OpenAI and the others when it comes to optimizing these things and taking them in interesting directions on a shoe string budget.

For example of what one sesh of tinkering can produce:

https://github.com/geohot/tinygrad/blob/master/examples/llam...

https://www.youtube.com/watch?v=nctqc8FBJ2U&t=4954s

The cat is out of the bag, you don't need a beowulf cluster of A100's and unlimited Azure credits. You do need a budget to train that is out of reach for hobbyists but the moat is not insurmountable and I don't think VC's will be scared off anymore as a lot of startup ideas are viable and a lot of outsiders can demonstrably make a real go of it.

Time for BasedAI. Game on.

Re: How 'Open' Is OpenAI, Really?

#33

Post by flanked-evergl »

m463 wrote: post #27
rgbrenner wrote: post #25

Earlier quoted context omitted.

I don't know if I buy the whole Microsoft got lucky part. I can remember years ago seeing Azure ads pushing machine learning. Github Copilot is now almost 2 years old (since the first "tech preview" announcement). Copilot is built on OpenAI/GPT-3 just like ChatGPT... and then a few months after Copilot, they made it available on Azure's OpenAI service. This is all in 2021. So they've been working on this and collecti…

They also did a course correction for "the internet" years ago... I have to give them credit, but the other side of the equation is that though they react quickly, they tend to duct-tape feature and products together. I'm thinking of how office went online yet has always lacked cohesion. Or how teams competes with zoom/slack/etc, yet is frustrating to work with.

Microsoft treats working software as secondary to marketing. They only build software to the point where it makes their marketing plausible to people who will never use the software and don't understand what it does, or what characteristics matter for it.

Re: How 'Open' Is OpenAI, Really?

#34

Post by bambax »

samspenc wrote: post #11

I think the article does a good job capturing the history of what happened. OpenAI started out with the intention of being a non-profit, but realized over time that it made it difficult to compete in terms of salary and hardware, so pivoted to a 'capped' for-profit. As for Microsoft, my guess is their investment was just another investment in a hot AI 'startup'. It was sheer luck, and being in the right place at the…

Non-profit to for-profit is one thing, but it shouldn't prevent them to actually open their technology. There are scores and scores of for-profit companies that do exactly that.

Continuing to call themselves "OpenAI" is disingenuous and frankly ridiculous at this point.

Re: How 'Open' Is OpenAI, Really?

#36

Post by otabdeveloper4 »

blackoil wrote: post #21

It may not be 'Open' in sense of open-source or free, but it is open that I can access it and use it in my projects. Before this companies like Google/Facebook had such models but closed in sense that we can get some papers and blog posts but can't rely on them to build our startup. Because of financial and people resources required, availability of data etc. rest always stayed. Now I can use ChatGPT, Gpt-3/4, Whispe…

That, like, an incredibly low bar as to what's considered "open".

(For all we know ChatGPT might be just an outsourced Indian call center under the hood. We don't actually know how it works.)

Re: How 'Open' Is OpenAI, Really?

#37

Post by can_center_divs »

recuter wrote: post #32

Now that it runs on our laptops a lot of the initial shock, mystique, and novelty has already worn off, just like with DALL-E before it. What the leaks show is that the community can run circles around OpenAI and the others when it comes to optimizing these things and taking them in interesting directions on a shoe string budget. For example of what one sesh of tinkering can produce: https://github.com/geohot/tinygra…

Yeah, the community always seems to figure out how to do things more effective.

My girlfriend asked me if I could transcribe some audio files for her with my "programming stuff". I immediately thought of Whisper from OpenAI.

I first used the official CLI tool. With the largest model it took long 8 hours to transcribe a 30 min long file. I noticed it was running on the CPU - tried switching it to use the GPU instead with no luck. Running it on WSL was probably not helping.

Then I found this gem: https://github.com/Const-me/Whisper A C++ Windows implementation of Whisper. I opened the program, fed it with the largest model and the file. The transcript was done in 4 minutes, instead of 8 hours... Downside? The program has a GUI, lol.

Of course, I could probably get the CLI tool to run on the GPU with some tinkering and installing some Nvidia packages for Whisper to use. But frankly, I have so little experience with that kind of stuff, that installing the Windows implementation was a much easier choice.

Re: How 'Open' Is OpenAI, Really?

#38

Post by [deleted] »

can_center_divs wrote: post #37
recuter wrote: post #32

Now that it runs on our laptops a lot of the initial shock, mystique, and novelty has already worn off, just like with DALL-E before it. What the leaks show is that the community can run circles around OpenAI and the others when it comes to optimizing these things and taking them in interesting directions on a shoe string budget. For example of what one sesh of tinkering can produce: https://github.com/geohot/tinygra…

Yeah, the community always seems to figure out how to do things more effective. My girlfriend asked me if I could transcribe some audio files for her with my "programming stuff". I immediately thought of Whisper from OpenAI. I first used the official CLI tool. With the largest model it took long 8 hours to transcribe a 30 min long file. I noticed it was running on the CPU - tried switching it to use the GPU instead w…

[deleted]

Re: How 'Open' Is OpenAI, Really?

#39

Post by FooBarWidget »

recuter wrote: post #32

Now that it runs on our laptops a lot of the initial shock, mystique, and novelty has already worn off, just like with DALL-E before it. What the leaks show is that the community can run circles around OpenAI and the others when it comes to optimizing these things and taking them in interesting directions on a shoe string budget. For example of what one sesh of tinkering can produce: https://github.com/geohot/tinygra…

ChatGPT can run on our laptops? How? The only thing I could find was that it can't because it requires 128 GB VRAM.

Re: How 'Open' Is OpenAI, Really?

#40

Post by recuter »

FooBarWidget wrote: post #39
recuter wrote: post #32

Now that it runs on our laptops a lot of the initial shock, mystique, and novelty has already worn off, just like with DALL-E before it. What the leaks show is that the community can run circles around OpenAI and the others when it comes to optimizing these things and taking them in interesting directions on a shoe string budget. For example of what one sesh of tinkering can produce: https://github.com/geohot/tinygra…

ChatGPT can run on our laptops? How? The only thing I could find was that it can't because it requires 128 GB VRAM.

https://github.com/ggerganov/llama.cpp/issues/39

40GB for the big llama.

Post reply on HN