Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 API General Availability

openai.com

Post reply on HN
Print view View original

481–490 of 562 posts

Re: GPT-4 API General Availability

#481

Post by ben_w »

jiggawatts wrote: post #309
keyle wrote: post #304

Earlier quoted context omitted.

It's one thing to vent frustration, but it's another to compare a capitalist startup to the Soviet Union... Get your facts right.

Sam Altman was giving people access to GPT 4 APIs because they attended a conference. "Lick my boots, in person, and you can be one of the privileged few" is very much the behaviour of a Communist dictatorship, not a capitalist corporation. I can spin up an Azure VM right now in almost any country I choose... except China. That's the only one where I have to beg the government for permission .

> "Lick my boots, in person, and you can be one of the privileged few" is very much the behaviour of a Communist dictatorship, not a capitalist corporation

It's both, and more besides. Veblen goods are absolutely a thing in capitalism.

Not that "giving people access to GPT 4 APIs because they attended a conference" should be controversial enough to even get worked up about, let alone to compare to a dictatorship, but Google did much the same at developer conferences: I/O 2012 swag list included a Galaxy Nexus, a Nexus 7, a Nexus Q, and a Chromebox.

Re: GPT-4 API General Availability

#482

Post by weird-eye-issue »

jwr wrote: post #473
weird-eye-issue wrote: post #469

Earlier quoted context omitted.

I built a production app on top of OpenAI and yeah there are frequent errors and timeouts but you literally just have to add some code to account for these and it works fine... For example exponential back off is the first step, then adding retrying on timeouts (we use streaming and if there are 30 seconds in between getting data back we retry the whole request - rare but happens), then fixing anything else that pops…

> Just fix your code and stop expecting OpenAI to hold your hand :-) My code does retry and the entire application is written to detect and work around breakage. But eventually I do need to get enough content from OpenAI API to be able to make progress, and I am not. At the moment, for example, all requests just time out after 12 minutes (on my side). No amount of "fixing my code" will help, and I don't want OpenAI t…

Something is seriously wrong with your network (or your code). That's it that's your answer. It's not OpenAI's fault.

We spend over $20k/mo with them and don't have any issues like this.

12 minute timeouts make no sense because first of all why are you even waiting 12 minutes?

Get off HN and go fix your shit

Re: GPT-4 API General Availability

#484

Post by cubefox »

Their complete shift away from providing access to untuned foundation models is interesting. Perhaps these are too powerful in some sense. They already removed the GPT-3.5 foundation model a while ago, and they never released it for GPT-4.

Re: GPT-4 API General Availability

#485

Post by N3cr0ph4g1st »

pachico wrote: post #455

OK, now I am intrigued by so many comments about how to do this yourself and, especially, for getting answers about your own document, which is what I'm really looking forward. I checked many of the links you posted and, although I am a fluid programmer in several languages, I lack the specific python background that many of these links seem to state as a requirement. Would any kind soul put me in the direction of an…

Easiest would honestly be just to use gpt api. You can literally fork a streamlit or chainlit app and run it locally and then use langchain for any further customization...ex:https://streamlit.io/gallery?category=llms

All of them are open source minus the gpt part so you can get a feel for how it works.

Re: GPT-4 API General Availability

#486

Post by ben_w »

kaba0 wrote: post #443
concordDance wrote: post #430

Earlier quoted context omitted.

> Sam tells Congress that AI is so dangerous it will extinct humanity. Why? So Congress can license him and only his buddies. No, he says it because its true and concerning. However, just because AGI has a good chance of making humanity extinct does not mean we're anywhere close to making AIs that capable. LLMs seem like a dead end.

> However, just because AGI has a good chance of making humanity extinct How? I mean surely it will lead humanity down some chaotic path, but I would fear climate catastrophe much much more than anything AI-related.

Imagine if you will that the companies responsible for the carbon emissions get themselves an AI, with no restrictions, and task it to endlessly spew pro-carbon propaganda and anti-green FUD.

That's one of the better outcomes.

A worse outcome is that an unrestricted AI helps walk a depressed and misanthropic teenager through the process of engineering airborne super-AIDS.

Or that someone suffering from a schizophrenic break reads "I Have No Mouth And I Must Scream" and tasks an unrestricted AI to make it real.

Or we have a bug we don't spot and the AI does any of those spontaneously; it's not like bugs are a mysterious thing which only exists in Hollywood plots.

Re: GPT-4 API General Availability

#487

Post by jwr »

weird-eye-issue wrote: post #482
jwr wrote: post #473

Earlier quoted context omitted.

> Just fix your code and stop expecting OpenAI to hold your hand :-) My code does retry and the entire application is written to detect and work around breakage. But eventually I do need to get enough content from OpenAI API to be able to make progress, and I am not. At the moment, for example, all requests just time out after 12 minutes (on my side). No amount of "fixing my code" will help, and I don't want OpenAI t…

Something is seriously wrong with your network (or your code). That's it that's your answer. It's not OpenAI's fault. We spend over $20k/mo with them and don't have any issues like this. 12 minute timeouts make no sense because first of all why are you even waiting 12 minutes? Get off HN and go fix your shit

I am very happy it works for you! But that does not imply that it works for everyone. Wish you all the best.

Re: GPT-4 API General Availability

#488

Post by wiihack »

ftxbro wrote: post #176

> "Starting today, all paying API customers have access to GPT-4." OK maybe I'm stupid but I am a paying OpenAI API customer and I don't have it yet. I see: gpt-3.5-turbo-16k gpt-3.5-turbo gpt-3.5-turbo-16k-0613 gpt-3.5-turbo-0613 gpt-3.5-turbo-0301 I don't see any gpt-4 Edit: Probably my problem is that I upgraded to paid API account within the last month, so I'm not technically a "paying API customer" yet according…

The official docs say, you need at least one successful API invoice to get access to GPT-4.

Re: GPT-4 API General Availability

#489

Post by logicchains »

jstummbillig wrote: post #222
john2x wrote: post #201

Earlier quoted context omitted.

Care to share some links? My lack of GPU is the main blocker for me from playing with local-only options. I have an old laptop with 16GB RAM and no GPU. Can I run these models?

Just a heads up: If you are more interested in being effective than being an evangelist, beware. While you can run all kinds of GPTs locally, GPT-4 still smokes everything right now – and even it is not actually good enough to not be a lynchpin for a lot of cases yet.

>GPT-4 still smokes everything right now

Not if you want it to write adult (graphically pornographic or violent) content.

Re: GPT-4 API General Availability

#490

Post by ben_w »

moffkalast wrote: post #461
concordDance wrote: post #430

Earlier quoted context omitted.

> Sam tells Congress that AI is so dangerous it will extinct humanity. Why? So Congress can license him and only his buddies. No, he says it because its true and concerning. However, just because AGI has a good chance of making humanity extinct does not mean we're anywhere close to making AIs that capable. LLMs seem like a dead end.

> its true and concerning > LLMs seem like a dead end These would seem contradictory. If you really think that both are true and Altman knows it, then you're saying he's a hype man lying for regulatory capture. And to some extent he definitely is overblowing the danger for his own gain. I really doubt they are a dead end though, we've barely started to explore what they can do. There's a lot more that can be extracte…

> These would seem contradictory.

Only if you believe that LLM is a synonym for AI, which OpenAI doesn't.

The things Altman have said seem entirely compatible with "the danger to humanity is ahead of us, not here and now", although in part that's because of the effort put into making GPT-4 refuse to write propaganda for Al Quaida, as per the red team safety report they published at the same time as releasing the model.

Other people are very concerned with here-and-now harms from AI, but that's stuff like "AI perpetuates existing stereotypes" and "when the AI reaches a bad decision, who do you turn to to get it overturned?" and "can we, like, not put autonomous tasers onto the Boston Dynamics Spot dogs we're using as cheap police substitutes?"

Post reply on HN