Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 API General Availability

openai.com

Post reply on HN
Print view View original

451–460 of 562 posts

Re: GPT-4 API General Availability

#451

Post by Jzush »

PostOnce wrote: post #197

Promote and proliferate local LLMs. If you use GPT, you're giving OpenAI money to lobby the government so they'll have no competitors, ultimately screwing yourself, your wallet, and the rest of us too. OpenAI has no moat, unless you give them money to write legislation. I can currently run some scary smart and fast LLMs on a 5 year old laptop with no GPU. The future is, at least, interesting.

I’m currently using the free tier ChatGPT web interface to help me with mundane coding tasks like JavaScript, php or css.

Is there a local solution that is at least as intelligent as GPT 3.5 in that regard that I can run in a container?

Re: GPT-4 API General Availability

#452

Post by andsoitis »

twbarr wrote: post #278
tensor wrote: post #242

Earlier quoted context omitted.

It doesn't have to be copyrightable to be intellectual property.

No, but what is it? Not your lawyer, not legal advice, but it's not a trade secret, they've given it to researchers. It's not a trademark because it's not an origin identifier. The structure might be patentable, but the weights won't be. It's certainly not a mask work. It might have been a contract violation for the guy who redistributed it, but I'm not a party to that contract.

> It might have been a contract violation for the guy who redistributed it, but I'm not a party to that contract.

Wouldn’t that violate the Nemo dat quod non habet legal principle and so you cannot hide behind the claim that you weren’t party to the contact?

https://en.wikipedia.org/wiki/Nemo_dat_quod_non_habet

Re: GPT-4 API General Availability

#453

Post by jiggawatts »

athyuttamre wrote: post #290
DomKM wrote: post #276

Earlier quoted context omitted.

While you're here, you should know that the logic for enabling GPT-4 API access is excluding Microsoft for Startups ( https://openai.com/microsoft-for-startups ) orgs which have valid billing against Microsoft-provided credits. Presumably, this is an oversight as it wouldn't make sense to exclude pre-existing Microsoft partners. Would you mind escalating this?

Thanks for pointing this out. Sharing with the relevant folks.

This is precisely what is wrong with OpenAI. This. Right here.

"Complaining on HN will get you access. You have know people or "complain in the right forums."

THERE SHOULD BE NO LOGIC.

No qualifying rules. No access checks. No gates. No hoops.

Sam Altman has gone on a worldwide interview tour claiming he wants to "democratise access to AI", meanwhile OpenAI is the least open company I have ever dealt with, or even heard of.

Oracle is more "democratic" and open, for crying out loud.

Re: GPT-4 API General Availability

#454

Post by bombolo »

dcow wrote: post #371
slaymaker1907 wrote: post #338

Earlier quoted context omitted.

I guess ignoring copyright and treating the whole internet as your training data does have its advantages.

Yes? That’s the point. Who cares about an outdated concept that has no digital analog? All the artists have moved on already #midjourney.

When mirosoft will open up all of their source code, I will agree with you.

Re: GPT-4 API General Availability

#455

Post by pachico »

OK, now I am intrigued by so many comments about how to do this yourself and, especially, for getting answers about your own document, which is what I'm really looking forward.

I checked many of the links you posted and, although I am a fluid programmer in several languages, I lack the specific python background that many of these links seem to state as a requirement.

Would any kind soul put me in the direction of an easy solution to run LLMs, potentially in AWS, that answers questions about your own docs? (I use Confluence but I can happily export pages.)

Thanks a lot in advance!!!

Re: GPT-4 API General Availability

#456

Post by nethdeco »

Art9681 wrote: post #373
kristianp wrote: post #297

Earlier quoted context omitted.

Gpt-4 runs on 8 x 220B params[1] and gpt is about 220B params(?). Local LLMs can be good for some tasks, but they are much slower and less capable than the size of model and hardware that openai brings to their apis. Even running a 7B model on the CPU in ggml is much slower than the gpt-3-turbo api, in my experience with a 12th gen i7 intel laptop. [1] GPT4 is 8 x 220B params = 1.7T params: https://news.ycombinator.c…

It's been well documented by now that the number of parameters does not necessarily translate to a better model. My guess is that OpenAI has learned a thing or two from the endless papers published daily that your "instance" of the model is not what it seems. They likely have a workflow that picks the best model suitable for your prompt. Some people may get a 13B permutation because it is "good enough" to produce a c…

Picking the best model based on the prompt seems to be the best way to simplify the task they are doing.

Re: GPT-4 API General Availability

#457

Post by gwd »

thomasfromcdnjs wrote: post #221
bravura wrote: post #188

Earlier quoted context omitted.

I've never used text-davinci-003 much. Why do you like it so much? What does it offer that the other models don't? What are funs things we can with it until it sunsets on January 4, 2024?

The Chat-GPT models are all pre-prompted and pre-aligned. If you work with davinci-003, it will never say things like, "I am an OpenAI bot and am unable to work with your unethical request" When using davinci the onus is on you to construct prompts (memories) which is fun and powerful. ==== 97% of API usage might be because of ChatGPT's general appeal to the world. But I think they will be losing a part of the hacker…

If you're using the API, you construct the "memories" as well, including the "system" prompt, even in the playground. (When you click the "(+) Add message", the new one defaults to USER, but you can click on it to change it to ASSISTANT, then fill it in with whatever you want.)

I used the "Complete" UI (from the Playground) for a bit before the "Chat" interface was available; I don't really think there's anything you couldn't do in the "Complete" UI that you couldn't also do in the "Chat" UI.

Re: GPT-4 API General Availability

#458

Post by kossTKR »

wordpad25 wrote: post #426
LeoPanthera wrote: post #406

Earlier quoted context omitted.

Everyone who complains about being "censored" never gives examples.

porn it’s always porn

Or literally anything other than the psychotically smarmy tone of GPT-4 that's almost impossible to remove and constantly gives warnings, disclaimers and stops itself if veering even just 1 mm off the most boring status quo perspectives.

Lots of my favorite and frankly the best litterature in the world have elements that are obscene, grotesque, bizarre, gritty, erotic, frightening, alternative, provocative - but that's just too much for chat-gpt, instead it has this - in my eyes - way more horrifying smiling-borg-like nature with only two allowed emotions: "ultra happiness", and "ultra obedience to the status quo".

Re: GPT-4 API General Availability

#459

Post by moffkalast »

PostOnce wrote: post #337
moffkalast wrote: post #292

Earlier quoted context omitted.

Yeah I mean I wouldn't really include coding models in this list since they're not general purpose models and have an obvious fine tuning edge compared to the rest. But WizardCoder is definitely something to look at as a Copilot replacement. I'd post a more well rounded benchmark but the problem is that all non-coding benchmarks are currently more or less complete garbage, especially the Vicuna benchmark that rates e…

The benchmark you linked was to "programming performance", not generic LLM "intelligence". The situation for the little guy is wildly better than most people imagine.

Yep, that's what I'm saying, programming performance is seemingly very indicative of model inteligence (assuming it's tuned well enough to be able to run the benchmark at all). Coding is an exercise in problem solving and abstract thinking after all.

There are exceptions of course, as there are a few models (e.g. Vicuna, Baize) that don't do well at coding at all but otherwise perform well for chat, and the coding models I mentioned that game the benchmark by sacrificing performance in all other areas.

If you exclude those, it's very a accurate overall reasoning level comparison, at least it fits most to what I've seen their performance was for various tasks when testing out individual models. The only other valid benchmark that isn't coding are the SAT and LSAT tests that OpenAI runs on all of their models, but afaik there isn't an open version that would be widely used.

Re: GPT-4 API General Availability

#460

Post by EagnaIonat »

Obscurity4340 wrote: post #434
PostOnce wrote: post #197

Promote and proliferate local LLMs. If you use GPT, you're giving OpenAI money to lobby the government so they'll have no competitors, ultimately screwing yourself, your wallet, and the rest of us too. OpenAI has no moat, unless you give them money to write legislation. I can currently run some scary smart and fast LLMs on a 5 year old laptop with no GPU. The future is, at least, interesting.

Where can we aquire or access these local LLMs? How much space and specs does it actually require?

Huggingface has them all.

https://huggingface.co

Post reply on HN