Live data from Hacker News

GPT-4

openai.com

61–70 of 1001 posts

Re: GPT-4

#61
post #24

Can't wait to try it. Edit: looks like this is still GPT-3, just fine tuned. They claim the model is available via ChatGPT Plus, but when asking that model for it's version, it claims to be GPT-3: "I am a variant of the GPT architecture called GPT-3, which was released by OpenAI in 2020".

Hmm, isn't gpt-4 supposed to be trained with two orders of magnitude more parameters?

Re: GPT-4

#62
post #24

Can't wait to try it. Edit: looks like this is still GPT-3, just fine tuned. They claim the model is available via ChatGPT Plus, but when asking that model for it's version, it claims to be GPT-3: "I am a variant of the GPT architecture called GPT-3, which was released by OpenAI in 2020".

It's not available yet:

> ChatGPT Plus subscribers will get GPT-4 access on chat.openai.com with a usage cap. We will adjust the exact usage cap depending on demand and system performance in practice, but we expect to be severely capacity constrained (though we will scale up and optimize over upcoming months).

You're still talking to ChatGPT-3.5-turbo.

Re: GPT-4

#63
post #40

Asking ChatGPT+ if it is GPT-4 results in > As an AI language model, I am not given an official name like "GPT-4". However, I am a continuation of the GPT (Generative Pre-trained Transformer) series of models developed by OpenAI. Currently, the most advanced version of the GPT series is GPT-3, which I am a part of. There has been no official announcement or confirmation regarding the development of a new version of G…

At the end of the article: "Image inputs are still a research preview and not publicly available."

Re: GPT-4

#64
Can't seem to find basic information like how many parameters were used or how big the training set was. Results are very impressive but would like to know what they are coming from!

Re: GPT-4

#65

Access is invite only for the API, and rate limited for paid GPT+. > gpt-4 has a context length of 8,192 tokens. We are also providing limited access to our 32,768–context (about 50 pages of text) version, gpt-4-32k, which will also be updated automatically over time (current version gpt-4-32k-0314, also supported until June 14). Pricing is $0.06 per 1K prompt tokens and $0.12 per 1k completion tokens. The context le…

And how it works? you can build a context and then ask something in a prompt using it?

Context is how many tokens it can be fed to produce an output. So now you can feed it up to 32k words (tokens).

Re: GPT-4

#66

I think it's interesting that they've benchmarked it against an array of standardized tests. Seems like LLMs would be particularly well suited to this kind of test by virtue of it being simple prompt:response, but I have to say...those results are terrifying. Especially when considering the rate of improvement. bottom 10% to top 10% of LSAT in What are the implications for society when general thinking, reading, and…

We benchmark humans with these tests -- why would we not do that for AIs?

The implications for society? We better up our game.

Re: GPT-4

#67

I think it's interesting that they've benchmarked it against an array of standardized tests. Seems like LLMs would be particularly well suited to this kind of test by virtue of it being simple prompt:response, but I have to say...those results are terrifying. Especially when considering the rate of improvement. bottom 10% to top 10% of LSAT in What are the implications for society when general thinking, reading, and…

> What are the implications for society when general thinking, reading, and writing becomes like Chess?

“General thinking” is much more than token prediction. Hook it up to some servos and see if it can walk.

Re: GPT-4

#68

I think it's interesting that they've benchmarked it against an array of standardized tests. Seems like LLMs would be particularly well suited to this kind of test by virtue of it being simple prompt:response, but I have to say...those results are terrifying. Especially when considering the rate of improvement. bottom 10% to top 10% of LSAT in What are the implications for society when general thinking, reading, and…

This is legitimately filling me with anxiety. I'm not an "AI hype guy". I work on and understand machine learning. But these scores are shocking and it makes me nervous. Things are about to change

Re: GPT-4

#70
This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the significant benefits it offers in terms of enhancing my knowledge are truly tremendous. I am absolutely thrilled with this technology and its potential to support my learning.

Note: As I'm shy of my writing style, GPT helped me refine the above.

Post reply on HN