Live data from Hacker News

GPT-4 API General Availability

openai.com

311–320 of 562 posts

Re: GPT-4 API General Availability

#311

Earlier quoted context omitted.

It's kind of incredible how fast OpenAI (now also known as ClosedAI) is going through the enshittification process. Even Facebook took around a decade to reach this level. OpenAI has an amazing core product, but in the span of six months: * Went from an amazing and inspiring open company that even put "Open" in their name to a fully locked up commercial beast. * Non-existent customers support and all kinds of borderl…

> * Use of cheap human labor in developing countries through shady anonymous companies (look up the company Sama who pay Kenyan workers about $1.5 an hour). If you pay a developing country developed country wages what you'll get is 1. inflation and 2. the government mad at you because all their essential workers/doctors/government officials are quitting to work for you.

This is a terrible excuse that I see trotted out far to often to justify going to developing countries and barely even paying workers that country's minimum wage. You absolutely can pay considerably more than minimum wage without disrupting the local economy. They're paying people as low as $1.32 per hour for an absolutely horrible job. I'm not expecting them to pay western wages. But even bumping that up to $2.50 or $3 an hour would make an incredible difference to the local workers lives. The fact that they don't do that is exploitation, pure and simple.

Note that I feel I have quite deep understanding of this issue, and feel strongly about it, because I live and work in a developing country and I see this happening a lot. Westerners come over here and treat local workers like shit, pay them peanuts for 80 hour weeks while making loads of money themselves and then justify it because "it's the local norm". It's sickening, frankly. We westerners doing business in developing countries are in a position of privilege and should be leading by example, not jumping on the first excuse to dump a hundred years worth of the fight for workers rights.

Re: GPT-4 API General Availability

#312
post #267

Earlier quoted context omitted.

The engineer is not part of the board which makes these decisions.

If they're taking their time to defend the company on the internet, they either have an ownership stake in it or they're a chump.

Or option 3, they're being paid to represent sneakily represent the company in a positive light.

Re: GPT-4 API General Availability

#313

Earlier quoted context omitted.

The Chat-GPT models are all pre-prompted and pre-aligned. If you work with davinci-003, it will never say things like, "I am an OpenAI bot and am unable to work with your unethical request" When using davinci the onus is on you to construct prompts (memories) which is fun and powerful. ==== 97% of API usage might be because of ChatGPT's general appeal to the world. But I think they will be losing a part of the hacker…

The hacker/builder ethos doesn't matter in the grand scheme of commercialization.

How do they want to commercialise it? Do they want moms to tinker on ChatGPT once a month to do their children's homework? Or do they want people to build businesses using their software

Re: GPT-4 API General Availability

#314
post #161

Earlier quoted context omitted.

It's kind of incredible how fast OpenAI (now also known as ClosedAI) is going through the enshittification process. Even Facebook took around a decade to reach this level. OpenAI has an amazing core product, but in the span of six months: * Went from an amazing and inspiring open company that even put "Open" in their name to a fully locked up commercial beast. * Non-existent customers support and all kinds of borderl…

> Use of cheap human labor in developing countries through shady anonymous companies (look up the company Sama who pay Kenyan workers about $1.5 an hour). What is wrong about injecting millions into developing nations? The rest I agree with, although I don't think it was ever really 'open' so its not getting shitty, it always was. Thankfully, "there is no moat" and other LLMs will be open, just a few months behind Op…

> What is wrong about injecting millions into developing nations?

Please don't try to reframe this to make exploitation a positive thing. See my other comment here.

https://news.ycombinator.com/item?id=36625438

Re: GPT-4 API General Availability

#315
post #304

Earlier quoted context omitted.

It's one thing to vent frustration, but it's another to compare a capitalist startup to the Soviet Union... Get your facts right.

Sam Altman was giving people access to GPT 4 APIs because they attended a conference. "Lick my boots, in person, and you can be one of the privileged few" is very much the behaviour of a Communist dictatorship, not a capitalist corporation. I can spin up an Azure VM right now in almost any country I choose... except China. That's the only one where I have to beg the government for permission .

You've clearly not experienced the reality of enterprise then. You're opinions are based on a limited understanding and knowledge of real life situations when it comes to this sort of stuff.

Re: GPT-4 API General Availability

#316

Earlier quoted context omitted.

Not disagreeing but just curious, why can't money buy enough GPU's? OpenAI's prices seem low enough that they could reasonably charge 2x or more to companies eager to get on the best models now.

They're giving people access to GPT-4 via Bing for free , but apparently can't accommodate paying API users!? That makes no sense. What makes much more sense -- especially if you listen to his interviews -- is that Sam Altman doesn't think you can be trusted with the power of GPT-4 via an API unless it has first been aligned to death.

"Free". The worst four-letter F word in America.

Re: GPT-4 API General Availability

#317

Earlier quoted context omitted.

Not disagreeing but just curious, why can't money buy enough GPU's? OpenAI's prices seem low enough that they could reasonably charge 2x or more to companies eager to get on the best models now.

They're giving people access to GPT-4 via Bing for free , but apparently can't accommodate paying API users!? That makes no sense. What makes much more sense -- especially if you listen to his interviews -- is that Sam Altman doesn't think you can be trusted with the power of GPT-4 via an API unless it has first been aligned to death.

Microsoft is giving that for free but I assume they're paying OpenAI for it.

And having such a big anchor tenant, its reasonable that you would prioritize them if GPUs are in short supply.

Re: GPT-4 API General Availability

#318

Earlier quoted context omitted.

ChatGPT is definitely more restricted than the API. Example: https://news.ycombinator.com/item?id=36179783

They are comparing text-davinci-003 with ChatGPT which presumably uses gpt-3.5-turbo, so quite different models. They are killing text-davinci-003 btw.

I've spent like $600 on text-davinci-003. This sucks!

Re: GPT-4 API General Availability

#319

The drip-feeding seems crazy to me. Open AI is undermining their reputation by forcing almost everybody to use the older, lower-quality models. Even if customers are willing to pay for GPT 4, they're being told to wait at the back of the line. Wait for what!? Christmas? When we can open our presents and have a GPT 4 inside? It's like they took a leaf from Google's "how to guarantee the failure of a new product" marke…

The problem is GPUs are hard to come by.

If we guesstimate that every 100 customers needs 1 NVIDIA GPU (completely random guess), then that means OpenAI needs to buy more GPUs for every 100 new customers using GPT-4. The problem is there's a GPU shortage so it's hard to add more GPUs by just throwing money at the problem.

https://www.fierceelectronics.com/electronics/ask-nvidia-ceo...

Re: GPT-4 API General Availability

#320

Earlier quoted context omitted.

> Today all existing API developers with a history of successful payments can access the GPT-4 API with 8K context. We plan to open up access to new developers by the end of this month, and then start raising rate-limits after that depending on compute availability. Same for me. I signed up only a few days ago and was excited to switch to "gpt-4" but I haven't paid the first bill (save the $5 capture) so I probably h…

Interesting, I did exactly the same (with the same name), but with GPT-4 support as well: https://www.pastery.net/ccvjrh/ It also does streaming, so it live-prints the response as it comes.

The llm command-line tool looks great:

https://llm.datasette.io/en/stable/

Post reply on HN