Live data from Hacker News

Microsoft eyes $10B bet on ChatGPT

semafor.com

341–350 of 541 posts

Re: Microsoft eyes $10B bet on ChatGPT

#341

I notice a few people lamenting that OpenAI will no longer be... open. But I have to wonder, in what sense is OpenAI open today ? In 2019, OpenAI transitioned from non-profit to for-profit. At that time, Microsoft invested US$1 billion into the company. OpenAI then announced its intention to commercially license its technologies.

Nearly everything openAI has showcased at least has a publicly published paper on how to reproduce what they have done. Sure, it isn't as good as source code and model weights... But having a paper probably reduces by 90% the time+money expense to reproduce the work.

Depends on what models we're talking about. I've heard reproducing ChatGPT would require on the order of ten million dollars' of compute.

Re: Microsoft eyes $10B bet on ChatGPT

#342
post #332

Earlier quoted context omitted.

Maybe the people involved are not old enough to ever have heard about Godwin's law? Its now 25 years ago that UseNet users have discovered this. I guess HN still needs a few years to get there.

Unfortunately, it seems commenters like "lynx23" haven't yet reached the age of reading the entire comment chain before writing a comment. Maybe then they'd realize the Nazi example was actually brought up by the comment two posts above me and I was just rolling with it as that's the current example in the discussion. I guess they still need a few years to get there.

I am sorry that you feel I attacked you directly. That was not my intention, nor did I word my reply such that this would be implied. I was refering to a group of people, and you decided to put yourself in that group and feel attacked.

Notice that I refered to a group, while you choose to vent your feelings by naming a person specifically, resorting to personal attack.

Maybe my age-reference wasn't that much of?

Re: Microsoft eyes $10B bet on ChatGPT

#343
post #280

Earlier quoted context omitted.

I think it's still crazy that in 2022 the fact that some stupid people can be offended by that have that much importance.

eh, it's all PR, no one really wants to be associated with that, one of the reasons why Apple forced Tumblr to remove porn which in turn decimated Tumblr's user base.

That makes very little sense. Is absolutely anyone going to decide against buying an Apple device, because Tumblr is on the App Store?

Re: Microsoft eyes $10B bet on ChatGPT

#344

I'm seeing a lot of responses that see ChatGPT replacing Google, and it's unclear to me how? It can replace queries like "what's the tallest mountain in France", but that's not really a profitable query for Google. Whereas it's unclear to me how it replaces "best vegetarian restaurants in Gastown". It can string together a coherent statement, but then I have to go search to see whether it actually recommended vegetar…

Have you used Google recently? It went from the only thing one would use, to utter trash now.

I use Google regularly. It consistently answers my queries via one of the top three links it returns.

What kind of questions are you having trouble answering via Google?

Re: Microsoft eyes $10B bet on ChatGPT

#345

Microsoft recently signed a deal with the London Stock Exchange. They took a 4% stake in LSE (roughly $1.5B) and in exchange LSE signed a $2.8B minimum spend commit on Microsoft Cloud products (Azure, O365 primarily). If the OpenAI deal were structured similarly, could imply a $20B contract for Microsoft... https://www.lseg.com/en/media-centre/press-releases/2022/lse...

I don't think OpenAI has 20B to spend on Microsoft products atm.

Re: Microsoft eyes $10B bet on ChatGPT

#346

Earlier quoted context omitted.

EDIT: A reply points out this message was wrong, I was accusing AlphaGo and AlphaZero of being closed, but that was Deepmind, not OpenAI.

AlphaGo and AlphaZero are Google/Deepmind, not OpenAI. They've released papers, and there's a model that reproduces the paper. https://en.wikipedia.org/wiki/Leela_Zero

Firstly, you are right about deepmind vs openai, woops.

While they released papers, I personally wouldn't have been happy reviewing the paper, because it was basically impossible for anyone to check (given how long Leela Zero took to get up to the same level). Releasing the network via bittorrent would have been very low cost.

I am impressed by Leela Zero, and independant duplication is still important, but it would have been even better to be able to directly compare it to AlphaZero & AlphaGo, rather than having them locked up.

Re: Microsoft eyes $10B bet on ChatGPT

#347

Earlier quoted context omitted.

Yes, we're all aware it's common practice to open source code. However, if the weights aren't provided and the data is unavailable or the compute is expensive, the code is worthless.

Does OpenAI provide weights, data, or even code?

They sometimes provide code, and less often pre-computed models. But we're not talking about their crown jewels, so the name OpenAI is completely misleading.

Re: Microsoft eyes $10B bet on ChatGPT

#349

Question to AI/ML folks : Is there no comparable open source model? Is the future going to be controlled by big corporations who own the models themselves? If models are so computationally intensive to produce does it mean than the more computational power a company has the better its models will be?

RE: Open Source models, there is the AnthropicAI model making the rounds on Twitter[1] and Stability.ai (makers of Stable Diffusion) are working on one [2]. If we use recent history as an example, OpenAI announced DALL-E in Jan 5, 2021 [3], announced v2 and a waitlist for public use in July 20, 2022, and Stable Diffusion shipped an open source model on August 22, 2022 [4] using ~$600K of compute (at retail prices on…

Stable Diffusion's code and model weights can be downloaded, but it's proprietary, not Open Source.

Re: Microsoft eyes $10B bet on ChatGPT

#350

Question to AI/ML folks : Is there no comparable open source model? Is the future going to be controlled by big corporations who own the models themselves? If models are so computationally intensive to produce does it mean than the more computational power a company has the better its models will be?

RE: Open Source models, there is the AnthropicAI model making the rounds on Twitter[1] and Stability.ai (makers of Stable Diffusion) are working on one [2]. If we use recent history as an example, OpenAI announced DALL-E in Jan 5, 2021 [3], announced v2 and a waitlist for public use in July 20, 2022, and Stable Diffusion shipped an open source model on August 22, 2022 [4] using ~$600K of compute (at retail prices on…

Does the AnthropicAI model have published weights? It is listed as closed in HELM[0].

[0]: https://crfm.stanford.edu/helm/v0.1.0/?models=1

Post reply on HN