Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 API General Availability

openai.com

Post reply on HN
Print view View original

331–340 of 562 posts

Re: GPT-4 API General Availability

#331

Post by incogitor »

aeyes wrote: post #144
santiagobasulto wrote: post #56

Earlier quoted context omitted.

I felt the same thing. The first version of GPT-4 I tried was crazy smart. Scary smart. Something happened afterwards…

I was playing with the API and found that it returned better answers than ChatGPT. ChatGPT isn't even able to solve simple Python problems anymore, even if you try to help it. And some time ago it did these same problems with ease. My guess is that they began to restrict ChatGPT because they can't sell that. They probably want to sell you CodeGPT or other products in the future so why would they give that away for fr…

Probably some combination of quantizing down from original fp16 weights and changes to the system prompt used for chat. Both can cause degraded quality, the former more than the latter.

Re: GPT-4 API General Availability

#332

Post by cyanydeez »

RugnirViking wrote: post #313
Fyrezerk wrote: post #231

Earlier quoted context omitted.

The hacker/builder ethos doesn't matter in the grand scheme of commercialization.

How do they want to commercialise it? Do they want moms to tinker on ChatGPT once a month to do their children's homework? Or do they want people to build businesses using their software

Mom and Pop offer more users with less legal exposure.

Re: GPT-4 API General Availability

#333

Post by penjelly »

electroly wrote: post #5
penjelly wrote: post #4

not in the article: is plugin usage available to paying customers everywhere now? i still can't see the ui for it. im in canada and use pro. internet says it was out for everyone in may..

Click the "..." button next to your name in the lower left corner, then Settings. It's under "Beta features."

wow i cannot believe i missed this for so long. thanks!

Re: GPT-4 API General Availability

#334

Post by cyanydeez »

eternityforest wrote: post #328

If we hadn't spammed the internet with AI generated shite, we wouldn't need the ChatGPT to dig through it and could just use Google... I'm not as excited about this as I am about most new tech. I'm sure there will be cool uses eventually but right now it seems like the primary use is to cheat at exams and write bad articles, and to ask the kind of questions Google could have answered 5 years ago. I do think it's cool…

Putin is shuttering the internet agency, probably because ChatGPT can do cheaper propaganda.

Recalibrate where you think AI provides "real" value

Re: GPT-4 API General Availability

#335

Post by cyanydeez »

w10-1 wrote: post #170
EnnioEvo wrote: post #10

Earlier quoted context omitted.

I have a startup of legal AI, the quality jump from GPT3.5 to GPT4 in this domain is straight mind-blowing, GPT3.5 in comparison is useless. But I see how in more conversational settings GPT3.5 can provide more appealing performance/price.

Legal writing is ideal training data: mostly formulaic, based on conventions and rules, well-formed and highly vetted, with much of the best in the public domain. Medical writing is the opposite, with unstated premises, semi-random associations, and rarely a meaningful sentence.

Legal writing is mostly pattern matching. Unfortunately, you're still gonna need to guard against hallucinations.

Re: GPT-4 API General Availability

#336

Post by flangola7 »

jiggawatts wrote: post #305
chrisshroba wrote: post #299

Earlier quoted context omitted.

Not disagreeing but just curious, why can't money buy enough GPU's? OpenAI's prices seem low enough that they could reasonably charge 2x or more to companies eager to get on the best models now.

They're giving people access to GPT-4 via Bing for free , but apparently can't accommodate paying API users!? That makes no sense. What makes much more sense -- especially if you listen to his interviews -- is that Sam Altman doesn't think you can be trusted with the power of GPT-4 via an API unless it has first been aligned to death.

Bing GPT-4 is a much smaller and less capable model than regular GPT-4.

Re: GPT-4 API General Availability

#337

Post by PostOnce »

moffkalast wrote: post #292
PostOnce wrote: post #260

Earlier quoted context omitted.

Your benchmark lacks the current #2 https://github.com/nlpxucan/WizardLM/tree/main/WizardCoder It beats Claude and Bard. You could probably get a 4bit 15B model going in 16GB of RAM and be approaching GPT4 in capability. ...on an old laptop, lol Let's eat OpenAI's lunch! They deserve it for trying to steal this tech by "privatizing" a charity, hiding scientific data that was supposed to be shared with us by said char…

Yeah I mean I wouldn't really include coding models in this list since they're not general purpose models and have an obvious fine tuning edge compared to the rest. But WizardCoder is definitely something to look at as a Copilot replacement. I'd post a more well rounded benchmark but the problem is that all non-coding benchmarks are currently more or less complete garbage, especially the Vicuna benchmark that rates e…

The benchmark you linked was to "programming performance", not generic LLM "intelligence".

The situation for the little guy is wildly better than most people imagine.

Re: GPT-4 API General Availability

#338

Post by slaymaker1907 »

jstummbillig wrote: post #222
john2x wrote: post #201

Earlier quoted context omitted.

Care to share some links? My lack of GPU is the main blocker for me from playing with local-only options. I have an old laptop with 16GB RAM and no GPU. Can I run these models?

Just a heads up: If you are more interested in being effective than being an evangelist, beware. While you can run all kinds of GPTs locally, GPT-4 still smokes everything right now – and even it is not actually good enough to not be a lynchpin for a lot of cases yet.

I guess ignoring copyright and treating the whole internet as your training data does have its advantages.

Re: GPT-4 API General Availability

#339

Post by ec109685 »

selcuka wrote: post #330
cptaj wrote: post #317

Earlier quoted context omitted.

Microsoft is giving that for free but I assume they're paying OpenAI for it. And having such a big anchor tenant, its reasonable that you would prioritize them if GPUs are in short supply.

> Microsoft is giving that for free but I assume they're paying OpenAI for it. Yeah, but Microsoft already gets 75% of the profits OpenAI makes, it's not the same price for them as the rest of us.

It’s the exactly the same. If they could make 75 cents selling the compute to someone else for $1 versus not making it providing the Bing chat service, that is 75 cents they lose.

Re: GPT-4 API General Availability

#340

Post by mr_toad »

jiggawatts wrote: post #283

The drip-feeding seems crazy to me. Open AI is undermining their reputation by forcing almost everybody to use the older, lower-quality models. Even if customers are willing to pay for GPT 4, they're being told to wait at the back of the line. Wait for what!? Christmas? When we can open our presents and have a GPT 4 inside? It's like they took a leaf from Google's "how to guarantee the failure of a new product" marke…

It’s an experiment. You are part of it.
Post reply on HN