Live data from Hacker News

GPT-4 API General Availability

openai.com

541–550 of 562 posts

Re: GPT-4 API General Availability

#543
post #176

> "Starting today, all paying API customers have access to GPT-4." OK maybe I'm stupid but I am a paying OpenAI API customer and I don't have it yet. I see: gpt-3.5-turbo-16k gpt-3.5-turbo gpt-3.5-turbo-16k-0613 gpt-3.5-turbo-0613 gpt-3.5-turbo-0301 I don't see any gpt-4 Edit: Probably my problem is that I upgraded to paid API account within the last month, so I'm not technically a "paying API customer" yet according…

The official docs say, you need at least one successful API invoice to get access to GPT-4.

That's weird, just make me prepay $5 for credits or something.

Re: GPT-4 API General Availability

#544
post #536
post #505

Earlier quoted context omitted.

I’m going to go out on a limb here and assume that you’re making this statement because it feels like they should have some intellectual property rights in this case. Independently of whether that feeling corresponds to legal reality (the original question) I would also encourage you to question the source of this feeling. I believe it is rooted in an ideology where information is restricted as property by default. T…

It has nothing to do with any sort of feeling. Perhaps you should check your own mental state. It is the same as any confidential data. Logs, readings from sensors, etc etc. If it's confidential and given to a 3rd party through a contract that doesn't mean that it's suddenly not confidential data for the rest of the world, even if the 3rd party leaks it. And if you really have a lawyer trying to tell you that some, a…

I think that just further shows your worldview that defaults to information/data as property. I think this is wrong both in the sense that it isn't really what the law says (but aren't going to agree here anyway) but more importantly I think what it should say. Information should not be and is not property by default. There are only three specific ways in which it can become property ("intellectual property"): copyright, trademark and patent. If it's none of those then the government doesn't get to make any rules about how anyone deals in the data because of the 1st Amendment. That's my understanding of the US system at least.

Re: GPT-4 API General Availability

#545
post #246

Earlier quoted context omitted.

https://gpt4all.io/index.html

Keep in mind it doesn't relate to GPT4, the 4 in the name is for, not four. But I should try it. TBH openAI shady practices and MS behind them is just an anti trust waiting to happen and I don't want a part in this dystopia

also, I fall in love easily with the entities I fabricate, I don't want someone else to have the option to take them away... don't worry, I have real friends too...

Re: GPT-4 API General Availability

#546
post #381

Earlier quoted context omitted.

OpenLLaMA is though. https://github.com/openlm-research/open_llama All of these are surmountable problems. We can beat OpenAI. We can drain their moat.

For the above, are the RAM figures system RAM or GPU?

CPU RAM

Re: GPT-4 API General Availability

#548
post #246

Earlier quoted context omitted.

https://gpt4all.io/index.html

Keep in mind it doesn't relate to GPT4, the 4 in the name is for, not four. But I should try it. TBH openAI shady practices and MS behind them is just an anti trust waiting to happen and I don't want a part in this dystopia

it does support GPT3.5 turbo and GPT4, you can put in an OpenAI key, it's amongst the model options.

Re: GPT-4 API General Availability

#549
post #446
post #273

Earlier quoted context omitted.

Can you elaborate on scary smart and fast? It's been a month or two since I've tried but the results were depressingly slow and useless for more or less every task I tried. Every time a model is claimed to be "90% of GPT-3" I get excited and every time it's very disappointing. (On that note, after using GPT-4, GPT-3 now seems disappointing almost every time I interact with it.)

In terms of speed, we're talking about 140t/s for 7B models, and 40t/s for 33B models on a 3090/4090 now.[1] (1 token ~= 0.75 word) It's quite zippy. llama.cpp performs close on Nvidia GPUs now (but they don't have a handy chart) and you can get decent performance on 13B models on M1/M2 Macs. You can take a look at a list of evals here: https://llm-tracker.info/books/evals/page/list-of-evals - for general usage, I th…

> https://github.com/turboderp/exllama

Is exllama an alternative to llama.cpp?

Re: GPT-4 API General Availability

#550

Earlier quoted context omitted.

It’s the exactly the same. If they could make 75 cents selling the compute to someone else for $1 versus not making it providing the Bing chat service, that is 75 cents they lose.

Why do you assume that the same amount of computing power would be used by someone else? There are only so many customers. You can't magically start selling more compute if you stop using it yourself.

At scale, GPU's are capacity constrained right now, so if Microsoft stopped using them, their capacity would be absorbed by others.
Post reply on HN