Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 API General Availability

openai.com

Post reply on HN
Print view View original

301–310 of 562 posts

Re: GPT-4 API General Availability

#301

Post by willsmith72 »

PostOnce wrote: post #197

Promote and proliferate local LLMs. If you use GPT, you're giving OpenAI money to lobby the government so they'll have no competitors, ultimately screwing yourself, your wallet, and the rest of us too. OpenAI has no moat, unless you give them money to write legislation. I can currently run some scary smart and fast LLMs on a 5 year old laptop with no GPU. The future is, at least, interesting.

My laptop already works too hard doing development and having chrome open, it's just not feasible. A good hosted alternative, sure, but local is not going to scale to the masses.

Re: GPT-4 API General Availability

#302

Post by jerrygenser »

chrisshroba wrote: post #299
mortehu wrote: post #288

Earlier quoted context omitted.

I think maybe you don't understand that they don't have enough GPUs to do this, and money can't buy enough GPUs to do it.

Not disagreeing but just curious, why can't money buy enough GPU's? OpenAI's prices seem low enough that they could reasonably charge 2x or more to companies eager to get on the best models now.

I think GPUs are in short supply and Nvidia can't make enough to keep up with demand.

Re: GPT-4 API General Availability

#303

Post by [deleted] »

cuuupid wrote: post #293
mortehu wrote: post #288

Earlier quoted context omitted.

I think maybe you don't understand that they don't have enough GPUs to do this, and money can't buy enough GPUs to do it.

This may be true but isn’t their official stance that their models are too powerful and could destroy Western civilization as we know it?

[deleted]

Re: GPT-4 API General Availability

#304

Post by keyle »

jiggawatts wrote: post #283

The drip-feeding seems crazy to me. Open AI is undermining their reputation by forcing almost everybody to use the older, lower-quality models. Even if customers are willing to pay for GPT 4, they're being told to wait at the back of the line. Wait for what!? Christmas? When we can open our presents and have a GPT 4 inside? It's like they took a leaf from Google's "how to guarantee the failure of a new product" marke…

It's one thing to vent frustration, but it's another to compare a capitalist startup to the Soviet Union... Get your facts right.

Re: GPT-4 API General Availability

#305

Post by jiggawatts »

chrisshroba wrote: post #299
mortehu wrote: post #288

Earlier quoted context omitted.

I think maybe you don't understand that they don't have enough GPUs to do this, and money can't buy enough GPUs to do it.

Not disagreeing but just curious, why can't money buy enough GPU's? OpenAI's prices seem low enough that they could reasonably charge 2x or more to companies eager to get on the best models now.

They're giving people access to GPT-4 via Bing for free, but apparently can't accommodate paying API users!?

That makes no sense.

What makes much more sense -- especially if you listen to his interviews -- is that Sam Altman doesn't think you can be trusted with the power of GPT-4 via an API unless it has first been aligned to death.

Re: GPT-4 API General Availability

#306

Post by esperent »

fragmede wrote: post #295
esperent wrote: post #140

Earlier quoted context omitted.

It's kind of incredible how fast OpenAI (now also known as ClosedAI) is going through the enshittification process. Even Facebook took around a decade to reach this level. OpenAI has an amazing core product, but in the span of six months: * Went from an amazing and inspiring open company that even put "Open" in their name to a fully locked up commercial beast. * Non-existent customers support and all kinds of borderl…

Not to nitpick, but if you're able to name the company employing Kenyans, Sama, who's homepage is at https://www.sama.com/ , with a team page at https://www.sama.com/our-team/ , I'm not sure you can complain that they're being shady and anonymous.

It's pretty shady. They have been fully exposed at this stage but from what I understand they were trying to keep a very low profile, going to efforts to make sure the Kenyan workers didn't know they were working for a company called Sama but instead using sub companies to sign the worker contracts.

https://time.com/6247678/openai-chatgpt-kenya-workers/

Re: GPT-4 API General Availability

#307

Post by jiggawatts »

ineedasername wrote: post #296
jiggawatts wrote: post #283

The drip-feeding seems crazy to me. Open AI is undermining their reputation by forcing almost everybody to use the older, lower-quality models. Even if customers are willing to pay for GPT 4, they're being told to wait at the back of the line. Wait for what!? Christmas? When we can open our presents and have a GPT 4 inside? It's like they took a leaf from Google's "how to guarantee the failure of a new product" marke…

They simply want control over the rollout of their product and how it is used. That, and perhaps opening the flood gates would produce scaling bottlenecks they’d rather stay ahead of than get behind. So they open things carefully, pull back when necessary like when they limited use of the public GPT-4 version of ChatGPT. That doesn’t seem too unreasonable. And yes sure, some amount of it might be attempts to manufact…

There's no scaling issues to speak of. These AIs are stateless, which makes them embarrassingly parallel. They can always just throw more GPUs at it. Microsoft even had some videos where they bragged about how these models can be run on any idle GPU around the world, dynamically finding resources wherever it is available!

If there's not enough GPUs at a certain price point, raise prices. Then lower prices later when GPUs become available.

They did it with GPT 3.5, so why not GPT 4?

Re: GPT-4 API General Availability

#308

Post by fnordpiglet »

dragonwriter wrote: post #274
fnordpiglet wrote: post #180

Earlier quoted context omitted.

If you don’t own the weights you don’t own anything. This is why open models are so crucial. I don’t understand any business who is building fine tuned models against closed models.

Owning weights is in a nebulous space right now, but if you don’t have custody of the weights and code to use them, you have nothing reliable, independent of whether the things you might wish to have are ownable (ownership is more about exclusion than ability to use, in any case.)

Yes. But the weights and instructions of how to use them to code can follow as we’ve seen. The key is ownership is bits on your machine not someone else’s. Better still on BitTorrent / ipfs:-)

Re: GPT-4 API General Availability

#309

Post by jiggawatts »

keyle wrote: post #304
jiggawatts wrote: post #283

The drip-feeding seems crazy to me. Open AI is undermining their reputation by forcing almost everybody to use the older, lower-quality models. Even if customers are willing to pay for GPT 4, they're being told to wait at the back of the line. Wait for what!? Christmas? When we can open our presents and have a GPT 4 inside? It's like they took a leaf from Google's "how to guarantee the failure of a new product" marke…

It's one thing to vent frustration, but it's another to compare a capitalist startup to the Soviet Union... Get your facts right.

Sam Altman was giving people access to GPT 4 APIs because they attended a conference.

"Lick my boots, in person, and you can be one of the privileged few" is very much the behaviour of a Communist dictatorship, not a capitalist corporation.

I can spin up an Azure VM right now in almost any country I choose... except China. That's the only one where I have to beg the government for permission.

Re: GPT-4 API General Availability

#310

Post by vore »

jiggawatts wrote: post #309
keyle wrote: post #304

Earlier quoted context omitted.

It's one thing to vent frustration, but it's another to compare a capitalist startup to the Soviet Union... Get your facts right.

Sam Altman was giving people access to GPT 4 APIs because they attended a conference. "Lick my boots, in person, and you can be one of the privileged few" is very much the behaviour of a Communist dictatorship, not a capitalist corporation. I can spin up an Azure VM right now in almost any country I choose... except China. That's the only one where I have to beg the government for permission .

How the world of enterprise sales works may come as an unpleasant surprise to you, then.
Post reply on HN