Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4

openai.com

Post reply on HN
Print view View original

191–200 of 1001 posts

Re: GPT-4

#191

Post by [deleted] »

minimaxir wrote: post #98
teruakohatu wrote: post #26

Access is invite only for the API, and rate limited for paid GPT+. > gpt-4 has a context length of 8,192 tokens. We are also providing limited access to our 32,768–context (about 50 pages of text) version, gpt-4-32k, which will also be updated automatically over time (current version gpt-4-32k-0314, also supported until June 14). Pricing is $0.06 per 1K prompt tokens and $0.12 per 1k completion tokens. The context le…

$0.12 per 1k completion tokens is high enough that it makes it prohibitively expensive to use the 32k context model. Especially in a chatbot use case with cumulative prompting, which is the best use case for such a large context vs. the default cheaper 8k window. In contrast, GPT-3.5 text-davinci-003 was $0.02/1k tokens, and let's not get into the ChatGPT API.

[deleted]

Re: GPT-4

#192

Post by reneberlin »

I found this competition with humans as a benchmark more than disturbing. By that measure gpt-4 already topped a lot of the average humans. But how can it be interpreted as a "gift" or "good product" to have AI that is human-like or super-human? Should we cheer? Sending contratulation mails? Invest? Hope for a better future? Try better? Self-host? What is the message in these benchmarks. Tests that have been designed for humans now get broken by computers for what outcome to be expected?

Re: GPT-4

#193

Post by _boffin_ »

arrosenberg wrote: post #112
_boffin_ wrote: post #70

This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the…

I'm very excited for the future wave of confidently incorrect people powered by ChatGPT.

We've had this before Chat and we'll have this after Chat.

Re: GPT-4

#194

Post by publius_ »

yoyohello13 wrote: post #120
_boffin_ wrote: post #70

This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the…

If you don't know the subject, how can you be sure what it's telling you is true? Do you vet what ChatGPT tells you with other sources? I don't really know Typescript, so I've been using it a lot to supplement my learning, but I find it really hard to accept any of its answers that aren't straight code examples I can test.

How do you know what a PhD is telling you is truth?

Unlike the PhD, the AI model has benchmark scores on truthfulness. Right now, they're looking pretty good.

Re: GPT-4

#196

Post by ml_basics »

minimaxir wrote: post #98
teruakohatu wrote: post #26

Access is invite only for the API, and rate limited for paid GPT+. > gpt-4 has a context length of 8,192 tokens. We are also providing limited access to our 32,768–context (about 50 pages of text) version, gpt-4-32k, which will also be updated automatically over time (current version gpt-4-32k-0314, also supported until June 14). Pricing is $0.06 per 1K prompt tokens and $0.12 per 1k completion tokens. The context le…

$0.12 per 1k completion tokens is high enough that it makes it prohibitively expensive to use the 32k context model. Especially in a chatbot use case with cumulative prompting, which is the best use case for such a large context vs. the default cheaper 8k window. In contrast, GPT-3.5 text-davinci-003 was $0.02/1k tokens, and let's not get into the ChatGPT API.

> Especially in a chatbot use case with cumulative prompting, which is the best use case for such a large context vs. the default cheaper 8k window.

Depends on what is up with the images and how they translate into tokens. I really have no idea, but could be that 32k tokens (lots of text) translates to only a few images for few-shot prompting.

The paper seems not to mention image tokenization, but I guess it should be possible to infer something about token rate when actually using the API and looking at how one is charged.

Re: GPT-4

#198

Post by woeirua »

I think if you had asked someone what would qualify as AGI twenty years ago, then GPT4 would be hitting most of their milestones…

The Star Trek computer is virtually assured by the end of the decade. All the components exist today in various forms.

Re: GPT-4

#199

Post by layer8 »

noisy_boy wrote: post #11

At this rate, I have no idea what the state of things would be even 6 months down the line.

Note that GPT-3 is 2.5 years old (counting from the beta), and that from what is publicly known, GPT-4 was already in development in 2021.
Post reply on HN