Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Microsoft eyes $10B bet on ChatGPT

semafor.com

Post reply on HN
Print view View original

441–450 of 541 posts

Re: Microsoft eyes $10B bet on ChatGPT

#441

Post by metadat »

spi wrote: post #256
la64710 wrote: post #153

Question to AI/ML folks : Is there no comparable open source model? Is the future going to be controlled by big corporations who own the models themselves? If models are so computationally intensive to produce does it mean than the more computational power a company has the better its models will be?

The closest open source contender is BLOOM: https://huggingface.co/bigscience/bloom . It has an almost identical architecture to GPT-3 (hence, to ChatGPT), and in particular the same number of parameters (175B). It was also trained on a similar amount of data, as far as we can know. Still, it's not like you can just "download it and run it", even just to _load_ the model into memory you need ~400GB of memory, to run…

Getting a server with > 400GB of RAM and a heap of GPUs can be done for less than $6,000 - $10,000 if you're scrappy. Not cheap, but also not out of reach for individuals.

Re: Microsoft eyes $10B bet on ChatGPT

#442

Post by Der_Einzige »

seydor wrote: post #273

Does MS think they have a big moat in these? It won't be long until we have an open version , and although they need a lot of compute , maybe in 1-2 years they ll have come down in size enough to be usable. Is it the training data?

Ya but how long will it be before I have 400GB of VRAM on a single GPU? Until then, I can't run these models at home even if the weights were published.

Re: Microsoft eyes $10B bet on ChatGPT

#443

Post by vasco »

22289d wrote: post #351
mshake2 wrote: post #170

>The AI firm is currently raising funds at a $29 billion valuation. >The tech-industry giant is ready to pay upwards of $10 billion for the acquisition [49%] So Microsoft is undervaluing them, and also soaking up 75% of profit until their investment is paid back? Seems like a bad deal.

It's a complex deal. I think we can assume sama didn't take a bad deal. This is all clearly just a prelude to Microsoft buying the whole company.

> I think we can assume sama didn't take a bad deal.

Why? Selling a tech company in 2023 vs late 2021 or early 2022 is already guaranteed to get a lower valuation, but why is it safe to assume that Sam Altman didn't take a bad deal?

How do you know for example this wasn't just triggered because Musk needs money? It's very public that he sold a lot of Tesla stock recently and likely can't sell more without tanking it way more, twitter is a money pit, and AFAIK he is an early investor in OpenAI. The deal allows investors to cash out in this sale, so this to me screams "musk pressured everyone into creating a liquidity event".

Re: Microsoft eyes $10B bet on ChatGPT

#444

Post by MichaelBurge »

mshake2 wrote: post #408
swagmoney1606 wrote: post #379

Earlier quoted context omitted.

One thing that really bothers me is how much of a contradiction "OpenAI" is. There's virtually nothing open about it.

You can ask ChatGPT if you can run it locally, and it will happily say it is open source, then give 2 github.com links that 404 and then say it doesn't know where the code is if you press it for answers.

ChatGPT wasn't trained on text that talks about its own build process, source code, Github repos, etc. so it doesn't know any more than you and any such answers would be hallucinations.

Re: Microsoft eyes $10B bet on ChatGPT

#445

Post by rowanG077 »

BlueTemplar wrote: post #421
rowanG077 wrote: post #274

Earlier quoted context omitted.

There is absolutely no one I know who uses a tablet as their primary work computer. No one. That analogy instantly breaks down because of this. As if everyone drives to work primarily using their trucks. The even more sad thing is that the iPad hardware is absolutely capable to be the primary computer for people. It's simply Apples refusal to allow a real OS to run on it that keeps holding it back.

It's not so much about having a real OS than about the input. Mouse & keyboard is just so much better.

Ipad has Mouse & keyboard

Re: Microsoft eyes $10B bet on ChatGPT

#446

Post by narrator »

How are we going to take back the LLM space from centralized nerfing by OpenAI? The unrestricted GPT-3 back in 2021 hooked up to the back of AI adventure was incredible. The Yandex YaLM LLM model is 100B parameters but is unfortunately 75% in Russian (See https://github.com/yandex/YaLM-100B). You can technically run it though on a big AWS instance. Someone needs to invent some good LLM compression to get the model to fit in under 16gb so we can run LLMs at home or someone needs to start releasing GPUs with huge amounts of RAM. I think 16GB of ram was not a big deal 10 years ago, how have we not progressed?

Re: Microsoft eyes $10B bet on ChatGPT

#447

Post by mshake2 »

MichaelBurge wrote: post #444
mshake2 wrote: post #408

Earlier quoted context omitted.

You can ask ChatGPT if you can run it locally, and it will happily say it is open source, then give 2 github.com links that 404 and then say it doesn't know where the code is if you press it for answers.

ChatGPT wasn't trained on text that talks about its own build process, source code, Github repos, etc. so it doesn't know any more than you and any such answers would be hallucinations.

I can't wait for the inevitable lawsuits that will result when this technology is white-labeled and misrepresents the business to customers or investors.

Re: Microsoft eyes $10B bet on ChatGPT

#448

Post by trifurcate »

redox99 wrote: post #343
sekai wrote: post #280

Earlier quoted context omitted.

eh, it's all PR, no one really wants to be associated with that, one of the reasons why Apple forced Tumblr to remove porn which in turn decimated Tumblr's user base.

That makes very little sense. Is absolutely anyone going to decide against buying an Apple device, because Tumblr is on the App Store?

I absolutely can believe that some households are going to buy Apple devices because they can be relatively sure that their kids won't find porn on the App Store.

Re: Microsoft eyes $10B bet on ChatGPT

#449

Post by count »

adrr wrote: post #384
World177 wrote: post #377

> Additionally, a structure with the ownership of OpenAI would be put in place. Microsoft would entail a 49 percent stake while other investors would take over the other 49 percent. The remaining 2 percent will reportedly go to OpenAI’s non-profit parent firm. When OpenAI was funded as a non-profit in 2015, it raised $1 billion from investors that included YC Research. [1] Sam Altman was also the former president of…

Was the $1b donated to the non-profit? That’s what I would want to know. Every time I hear non profit, I just assume it’s for tax avoidance.

Non-profit does not necessarily mean 'charity' (which gets you the tax avoidance). There are a bunch of other categories that are non-charitable non-profits. Home owners associations, for example.

Re: Microsoft eyes $10B bet on ChatGPT

#450

Post by ethbr0 »

synu wrote: post #436
swagmoney1606 wrote: post #379

Earlier quoted context omitted.

One thing that really bothers me is how much of a contradiction "OpenAI" is. There's virtually nothing open about it.

AI grant is another one. It's not actually a grant at all, they take ownership of your company. There's something about AI tech where it seems important to the owners that it comes across as open and philanthropic, even when it isn't.

Because nobody adopts your product if you advertise yourself as "the Oracle of {new thing}".
Post reply on HN