Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 API General Availability

openai.com

Post reply on HN
Print view View original

521–530 of 562 posts

Re: GPT-4 API General Availability

#521

Post by kaba0 »

jabradoodle wrote: post #506
kaba0 wrote: post #503

Earlier quoted context omitted.

> with no restrictions, and task it to endlessly spew pro-carbon propaganda and anti-green FUD. So what we have ongoing for half a century? I honestly don’t see what changes here — super-human intelligence has limited benefits as it scales. Would you suddenly have more power in life, were you twice as smart? If so, we would have math professors as world leaders. Life can’t be “won” by intelligence, that is only one f…

> Life can’t be “won” by intelligence Humans being the dominant life form on Earth may suggest otherwise. > I honestly don’t see what changes here — super-human intelligence has limited benefits as it scales. Would you suddenly have more power in life, were you twice as smart? If so, we would have math professors as world leaders. Intelligent humans by definition do not have super human intelligence.

We know that this amount of intelligence was a huge evolutionary advantage. That tells us nothing whether being twice as smart would continue to give better results. But arguably the advantages of intelligence are diminishing, otherwise we would have much smarter people in more powerful positions.

Also, a big tongue in cheek but someone like John von Neumann definitely had superhuman intelligence.

Re: GPT-4 API General Availability

#522

Post by reaperman »

fnordpiglet wrote: post #199
reaperman wrote: post #185

Earlier quoted context omitted.

Right now the closed models are incredibly higher quality than the open models. They're useful as a stopgap for 1-2 years in hopes/expectation of open models reaching a point where they can be swapped in. It burns cash now, but in exchange you can grab more market share sooner while you're stuck using the expensive but high quality OpenAI models. It's not cost-effective, but it may be part of a valid business plan.

That should be a wake up call to every corporation pinning their business on OAI models. My experience thus far is no one is seeing a need to plan an exit from OAI, and the perception is “AI is magic and we aren’t magicians.” There needs to be a concerted effort to finance and tune high quality freely available models and tool chains asap. That said I think efficiencies will dramatically improve over the next few yea…

> There needs to be a concerted effort to finance and tune high quality freely available models and tool chains asap.

Absolutely. A large consortium of companies could each contribute 0.2-2% of the total cost and fund something much larger than OpenAI.

Re: GPT-4 API General Availability

#523

Post by hnfong »

esperent wrote: post #378
hnfong wrote: post #357

Earlier quoted context omitted.

I'm curious. When you buy a loaf of bread from the local market, are they cheaper than first world prices? If so, do you pay double the listed price and demand the shop pay double the price to hire workers so as to not exploit them? Are your expenses in said developing country lower than what you would have paid if you were in a richer country? Are you donating the difference to the local community? Just curious.

It's weird how people always trot out phrases like "I'm just curious" or "I'm just asking questions here" when they try to justify exploitation. Is it so that you have plausible deniability when you inevitably get called on it? Because that doesn't work.

I see that you have pretty extreme takes on what constitutes "exploitation". It's one thing to pretend that you're not part of it if you live on another part of the planet and pretend globalization doesn't exist, but I was wondering how you'd avoid participating in it if you lived in the same country and economic bubble as the ones you claim are exploited.

If you had a morally consistent way to live that life, you'd have my respect. But no, you had to deflect the topic to a phrase I wrote and make presumptions about what I really meant.

FYI, I'm morally at ease with myself, I don't need to justify anything to anyone.

Re: GPT-4 API General Availability

#524

Post by w3designer »

nethdeco wrote: post #456
Art9681 wrote: post #373

Earlier quoted context omitted.

It's been well documented by now that the number of parameters does not necessarily translate to a better model. My guess is that OpenAI has learned a thing or two from the endless papers published daily that your "instance" of the model is not what it seems. They likely have a workflow that picks the best model suitable for your prompt. Some people may get a 13B permutation because it is "good enough" to produce a c…

Picking the best model based on the prompt seems to be the best way to simplify the task they are doing.

It does seem like a good approach, though that seems to imply that they understand the context of the prompt being entered. Has anyone tackled this context sensitive model routing? It seems like a good approach, but likely not straightforward.

Re: GPT-4 API General Availability

#525

Post by ben_w »

kaba0 wrote: post #521
jabradoodle wrote: post #506

Earlier quoted context omitted.

> Life can’t be “won” by intelligence Humans being the dominant life form on Earth may suggest otherwise. > I honestly don’t see what changes here — super-human intelligence has limited benefits as it scales. Would you suddenly have more power in life, were you twice as smart? If so, we would have math professors as world leaders. Intelligent humans by definition do not have super human intelligence.

We know that this amount of intelligence was a huge evolutionary advantage. That tells us nothing whether being twice as smart would continue to give better results. But arguably the advantages of intelligence are diminishing, otherwise we would have much smarter people in more powerful positions. Also, a big tongue in cheek but someone like John von Neumann definitely had superhuman intelligence.

> But arguably the advantages of intelligence are diminishing, otherwise we would have much smarter people in more powerful positions.

Smart people get what they want more often than less smart people. This can include positions of power, but not always — leadership decisions come with the cost of being responsible for things going wrong, so people who have a sense of responsibility (or empathy for those who suffer from their inevitable mistakes) can feel it's not for them.

This is despite the fact that successful power-seeking enables one to get more stuff done. (My impression of Musk is he's one who seeks arbitrary large power to get as much as possible done; I'm very confused about if he feels empathy towards those under him or not, as I see a very different personality between everything Twitter and everything SpaceX).

And even really dumb leaders (of today, not inbred monarchies) are generally above average intelligence.

Re: GPT-4 API General Availability

#526

Post by VladimirGolovin »

PostOnce wrote: post #197

Promote and proliferate local LLMs. If you use GPT, you're giving OpenAI money to lobby the government so they'll have no competitors, ultimately screwing yourself, your wallet, and the rest of us too. OpenAI has no moat, unless you give them money to write legislation. I can currently run some scary smart and fast LLMs on a 5 year old laptop with no GPU. The future is, at least, interesting.

Can you recommend some local LLMs that are (roughly) equivalent to ChatGPT?

Re: GPT-4 API General Availability

#527

Post by kaba0 »

ben_w wrote: post #525
kaba0 wrote: post #521

Earlier quoted context omitted.

We know that this amount of intelligence was a huge evolutionary advantage. That tells us nothing whether being twice as smart would continue to give better results. But arguably the advantages of intelligence are diminishing, otherwise we would have much smarter people in more powerful positions. Also, a big tongue in cheek but someone like John von Neumann definitely had superhuman intelligence.

> But arguably the advantages of intelligence are diminishing, otherwise we would have much smarter people in more powerful positions. Smart people get what they want more often than less smart people. This can include positions of power, but not always — leadership decisions come with the cost of being responsible for things going wrong, so people who have a sense of responsibility (or empathy for those who suffer f…

That doesn’t contradict what I said. There is definitely a huge benefit to an IQ 110 over 70. But there is not that big a jump between 110 and 150, let alone even further.

Re: GPT-4 API General Availability

#528

Post by SergeAx »

lmm wrote: post #267
tarruda wrote: post #194

Earlier quoted context omitted.

The engineer is not part of the board which makes these decisions.

If they're taking their time to defend the company on the internet, they either have an ownership stake in it or they're a chump.

They may defend the product, not the company. It is normal for engineers to be emotionally invested in their products.

Re: GPT-4 API General Availability

#529

Post by staticman2 »

pbmonster wrote: post #432
wokwokwok wrote: post #419

Earlier quoted context omitted.

Whaaaaat, how are you getting 100ms per token on an 5 year old potato without a graphics card? Like, not vaguely hand wavey stuff, specifically, what model and what inference code? I get nothing like that performance for the 7B models, forget the larger models, using llama.cpp on a pc without an nvidia GPU.

I'm running TheBlokes wizard-vicuna-13b-superhot-8k.ggmlv3 with 4-bit quantization on a Ryzen 5 that's probably older than OPs laptop. I get around 5 tokens a second using the webui that comes with oogabooga using default settings. If I understand correctly, this does not get me 8k context length yet, because oogabooga doesn't have NTK-aware scaled RoPE implemented yet. Using the same model with the newest kobold.cpp…

"Note that this model is great at creative writing"

Could you elaorate on what you mean by that, like, are you telling it to write you a short story and it does a good job? My experiments with using these models for creative writing have not been particularly inspiring.

Re: GPT-4 API General Availability

#530

Post by staticman2 »

yard2010 wrote: post #425
LeoPanthera wrote: post #406

Earlier quoted context omitted.

Everyone who complains about being "censored" never gives examples.

I'm trying to create a bot that joins my friends Telegram group and melds into the conversation as if it was a real person. A real person might be the most cute and fun enthusiastic person there is but sometimes it has bad days, or it tells inappropriate jokes, right? People are complicated. Not this bot! No matter what prompt I'm using (with the chat API) it won't lose the happy happy joy joy chatGPT attitude, won't…

You should look at the code for Sillytavern. It's capable of prompting GPT 3.5 to take on a character and act like a jerk.
Post reply on HN