Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 API General Availability

openai.com

Post reply on HN
Print view View original

261–270 of 562 posts

Re: GPT-4 API General Availability

#261

Post by MiSeRyDeee »

ftxbro wrote: post #176

> "Starting today, all paying API customers have access to GPT-4." OK maybe I'm stupid but I am a paying OpenAI API customer and I don't have it yet. I see: gpt-3.5-turbo-16k gpt-3.5-turbo gpt-3.5-turbo-16k-0613 gpt-3.5-turbo-0613 gpt-3.5-turbo-0301 I don't see any gpt-4 Edit: Probably my problem is that I upgraded to paid API account within the last month, so I'm not technically a "paying API customer" yet according…

I was a on paid account since last month and was never really billed for my $8 dollar usage. I don't have GPT-4 access either.

Re: GPT-4 API General Availability

#262

Post by dimgl »

PostOnce wrote: post #197

Promote and proliferate local LLMs. If you use GPT, you're giving OpenAI money to lobby the government so they'll have no competitors, ultimately screwing yourself, your wallet, and the rest of us too. OpenAI has no moat, unless you give them money to write legislation. I can currently run some scary smart and fast LLMs on a 5 year old laptop with no GPU. The future is, at least, interesting.

I'd love to get into AI and AI development. Where can I start?

Re: GPT-4 API General Availability

#263

Post by musha68k »

PostOnce wrote: post #197

Promote and proliferate local LLMs. If you use GPT, you're giving OpenAI money to lobby the government so they'll have no competitors, ultimately screwing yourself, your wallet, and the rest of us too. OpenAI has no moat, unless you give them money to write legislation. I can currently run some scary smart and fast LLMs on a 5 year old laptop with no GPU. The future is, at least, interesting.

One has to give them credit for what must be the most grandiose stunt actually landed. And on so many angles! “It just works” - they even got the scientists fully aligned! Fiercely smart industriousness.

https://youtu.be/P_ACcQxJIsg?t=5946

Re: GPT-4 API General Availability

#264

Post by btown »

simonw wrote: post #206
flangola7 wrote: post #184

Earlier quoted context omitted.

They address that, OpenAI will cover the cost of re-training on the new models, and the old models don't discontinue until next year.

Did they say they would cover the cost of fine-tuning again? I saw them say they would cover the cost of recalculating embeddings, but I didn't see the bit about fine-tuning costs. On fine-tuning: > We will be providing support to users who previously fine-tuned models to make this transition as smooth as possible. On embeddings: > We will cover the financial cost of users re-embedding content with these new models.

This indicates to me that some of the old base models used architectures that were significantly more difficult to run at scale (or to ship around/load different weights at scale) - which is truly saying something, since they were running at incredible scale a year ago. There's probably a decade of potential papers from their optimizations alone (to say nothing of their devops innovations) that are still trade secrets.

Re: GPT-4 API General Availability

#265

Post by RC_ITR »

jxy wrote: post #57

They didn't mention gpt-4-32k. Does anybody know if it will be generally available in the same timeframe? There's still no news about the multi-modal gpt-4. I guess the image input is just too expensive to run or it's actually not as great as they hyped it.

>I guess the image input is just too expensive to run or it's actually not as great as they hyped it.

We already know they have a SOTA model that can turn images into latent space vectors without being some insane resource hog - in fact, they give it away to competitors like Stability. [0]

My guess is a limited set of people are using the GPT-4 with CLIP hybrid, but those use-cases are mostly trying to decipher pictures of text (which it would be very bad at), so they're working on that (or other use-case problems).

[0]https://github.com/openai/CLIP

Re: GPT-4 API General Availability

#266

Post by jeron »

drexlspivey wrote: post #223
electroly wrote: post #5

Earlier quoted context omitted.

Click the "..." button next to your name in the lower left corner, then Settings. It's under "Beta features."

I pay monthly for my API use but I am not a plus subscriber and I don't see this option. Also I've joined the plugins waiting list on day 1.

as it turns out, you are not paying enough basically

Re: GPT-4 API General Availability

#267

Post by lmm »

tarruda wrote: post #194
esperent wrote: post #140

Earlier quoted context omitted.

It's kind of incredible how fast OpenAI (now also known as ClosedAI) is going through the enshittification process. Even Facebook took around a decade to reach this level. OpenAI has an amazing core product, but in the span of six months: * Went from an amazing and inspiring open company that even put "Open" in their name to a fully locked up commercial beast. * Non-existent customers support and all kinds of borderl…

The engineer is not part of the board which makes these decisions.

If they're taking their time to defend the company on the internet, they either have an ownership stake in it or they're a chump.

Re: GPT-4 API General Availability

#268

Post by Xeophon »

leodriesch wrote: post #113
furyofantares wrote: post #78

Not a lot of talk of Whisper being available here. From using voice in the ChatGPT iOS app, I surmise that Whisper is very good at working out what you've actually said. But it's really annoying to have to say my whole bit before getting any feedback about what it's gonna think I said. Even if it's getting it right at an impressive rate. Given this is how OpenAI themselves use it (say your whole thing before getting…

I'm interested in how the transformer based speech recognition from iOS 17 will perform compared to Whisper. I guess it will work more "real-time" like the current dictation on iOS/macOS, but I'm unsure as I am not on the beta right now.

I am a beta user and I am seriously impressed if I’m being honest. It works fully offline, is multilingual and is fast, even on the non-latest iPhone (I am using an iPhone 12 Pro Max). It is way better than apples previous version and better than locally installed whisper. They’ve done incredible work. Same with the new, transformer-based keyboard on iOS which is way better. And if you type in English, it sometimes shows word suggestions in the text field itself (similar how copilot works in an IDE).

Re: GPT-4 API General Availability

#269

Post by jonplackett »

musha68k wrote: post #263
PostOnce wrote: post #197

Promote and proliferate local LLMs. If you use GPT, you're giving OpenAI money to lobby the government so they'll have no competitors, ultimately screwing yourself, your wallet, and the rest of us too. OpenAI has no moat, unless you give them money to write legislation. I can currently run some scary smart and fast LLMs on a 5 year old laptop with no GPU. The future is, at least, interesting.

One has to give them credit for what must be the most grandiose stunt actually landed. And on so many angles! “It just works” - they even got the scientists fully aligned! Fiercely smart industriousness. https://youtu.be/P_ACcQxJIsg?t=5946

No equity? For real? He really does need an agent if that's the case.

Re: GPT-4 API General Availability

#270

Post by lolinder »

londons_explore wrote: post #259
eli wrote: post #255

Earlier quoted context omitted.

The former seems very believable. And I bet a lot of the fine tuned models that are active are still part of prototypes or experiments. I assume if you reach out they throw some credits at you

If it really was a tiny number of users, they would publically make a really good offer - for example: "Unfortunately, you will need to retune your models on top of GPT-4. OpenAI will do this for you for free, and refund all money you paid tuning your original model, and offer the new model for the same price as the original model." The extra trust gained by seeing another customer treated that way easily pays for a…

OpenAI probably doesn't feel the need to pay to win publicity right now—they've been in the spotlight for as long as LLMs have been a thing, and GPT-4 is far ahead of competitors' offerings.
Post reply on HN