Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 API General Availability

openai.com

Post reply on HN
Print view View original

321–330 of 562 posts

Re: GPT-4 API General Availability

#321

Post by whimsicalism »

andai wrote: post #273
PostOnce wrote: post #197

Promote and proliferate local LLMs. If you use GPT, you're giving OpenAI money to lobby the government so they'll have no competitors, ultimately screwing yourself, your wallet, and the rest of us too. OpenAI has no moat, unless you give them money to write legislation. I can currently run some scary smart and fast LLMs on a 5 year old laptop with no GPU. The future is, at least, interesting.

Can you elaborate on scary smart and fast? It's been a month or two since I've tried but the results were depressingly slow and useless for more or less every task I tried. Every time a model is claimed to be "90% of GPT-3" I get excited and every time it's very disappointing. (On that note, after using GPT-4, GPT-3 now seems disappointing almost every time I interact with it.)

i think the falcon instruct is considered pretty good but if you are expectation set by gpt4 it still will not compare

Re: GPT-4 API General Availability

#322

Post by stavros »

JimDabell wrote: post #320
stavros wrote: post #207

Earlier quoted context omitted.

Interesting, I did exactly the same (with the same name), but with GPT-4 support as well: https://www.pastery.net/ccvjrh/ It also does streaming, so it live-prints the response as it comes.

The llm command-line tool looks great: https://llm.datasette.io/en/stable/

It does, thanks for this! I didn't know about it.

Re: GPT-4 API General Availability

#323

Post by whimsicalism »

jonplackett wrote: post #269
musha68k wrote: post #263

Earlier quoted context omitted.

One has to give them credit for what must be the most grandiose stunt actually landed. And on so many angles! “It just works” - they even got the scientists fully aligned! Fiercely smart industriousness. https://youtu.be/P_ACcQxJIsg?t=5946

No equity? For real? He really does need an agent if that's the case.

If you listen to him talk at any point, you can see him explain why.

Re: GPT-4 API General Availability

#324

Post by ftxbro »

JimDabell wrote: post #320
stavros wrote: post #207

Earlier quoted context omitted.

Interesting, I did exactly the same (with the same name), but with GPT-4 support as well: https://www.pastery.net/ccvjrh/ It also does streaming, so it live-prints the response as it comes.

The llm command-line tool looks great: https://llm.datasette.io/en/stable/

are we out here typing our api keys into random pips and am i a boomer that i would be hesitant to do it

Re: GPT-4 API General Availability

#325

Post by smeagull »

It's a shame they've stuck with the Chat completions. I still see no evidence the system is able to correctly separate user from system prompting. It commonly confuses between the two. If your system prompt comes close to the user prompts, you will see collisions and confusion in the outputs.

It's also a shame that the API is so cut down, and removes all the good options that text completions had.

I only hope their competition are better.

Re: GPT-4 API General Availability

#326

Post by smeagull »

Teandw wrote: post #315
jiggawatts wrote: post #309

Earlier quoted context omitted.

Sam Altman was giving people access to GPT 4 APIs because they attended a conference. "Lick my boots, in person, and you can be one of the privileged few" is very much the behaviour of a Communist dictatorship, not a capitalist corporation. I can spin up an Azure VM right now in almost any country I choose... except China. That's the only one where I have to beg the government for permission .

You've clearly not experienced the reality of enterprise then. You're opinions are based on a limited understanding and knowledge of real life situations when it comes to this sort of stuff.

Seems correct to me. This is a good assessment of the personalities involved.

Re: GPT-4 API General Availability

#327

Post by mandmandam »

browningstreet wrote: post #210
whalesalad wrote: post #166

Earlier quoted context omitted.

It definitely got nerfed.

I've never seen "nerf" used colloquially and today i've seen it at least a half-dozen times across various sites. Y'all APIs?

I've heard nerf used colloquially since like the 90's.

?

Re: GPT-4 API General Availability

#328

Post by eternityforest »

If we hadn't spammed the internet with AI generated shite, we wouldn't need the ChatGPT to dig through it and could just use Google...

I'm not as excited about this as I am about most new tech. I'm sure there will be cool uses eventually but right now it seems like the primary use is to cheat at exams and write bad articles, and to ask the kind of questions Google could have answered 5 years ago.

I do think it's cool that it can debug and review code though.

Re: GPT-4 API General Availability

#329

Post by jiggawatts »

Teandw wrote: post #315
jiggawatts wrote: post #309

Earlier quoted context omitted.

Sam Altman was giving people access to GPT 4 APIs because they attended a conference. "Lick my boots, in person, and you can be one of the privileged few" is very much the behaviour of a Communist dictatorship, not a capitalist corporation. I can spin up an Azure VM right now in almost any country I choose... except China. That's the only one where I have to beg the government for permission .

You've clearly not experienced the reality of enterprise then. You're opinions are based on a limited understanding and knowledge of real life situations when it comes to this sort of stuff.

I’ve only worked in big enterprise and big government for over two decades.

I know exactly how this works.

When someone has power, they will use it. In small, petty ways, or big “do me favours for access” ways.

Re: GPT-4 API General Availability

#330

Post by selcuka »

cptaj wrote: post #317
jiggawatts wrote: post #305

Earlier quoted context omitted.

They're giving people access to GPT-4 via Bing for free , but apparently can't accommodate paying API users!? That makes no sense. What makes much more sense -- especially if you listen to his interviews -- is that Sam Altman doesn't think you can be trusted with the power of GPT-4 via an API unless it has first been aligned to death.

Microsoft is giving that for free but I assume they're paying OpenAI for it. And having such a big anchor tenant, its reasonable that you would prioritize them if GPUs are in short supply.

> Microsoft is giving that for free but I assume they're paying OpenAI for it.

Yeah, but Microsoft already gets 75% of the profits OpenAI makes, it's not the same price for them as the rest of us.

Post reply on HN