Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4

openai.com

Post reply on HN
Print view View original

121–130 of 1001 posts

Re: GPT-4

#121

Post by nopinsight »

Atreiden wrote: post #37

I think it's interesting that they've benchmarked it against an array of standardized tests. Seems like LLMs would be particularly well suited to this kind of test by virtue of it being simple prompt:response, but I have to say...those results are terrifying. Especially when considering the rate of improvement. bottom 10% to top 10% of LSAT in What are the implications for society when general thinking, reading, and…

Although GPT-4 scores excellently in tests involving crystallized intelligence, it still struggles with tests requiring fluid intelligence like competitive programming (Codeforces), Leetcode (hard), and AMC. (Developers and mathematicians are still needed for now).

I think we will probably get (non-physical) AGI when the models can solve these as well. The implications of AGI might be much bigger than the loss of knowledge worker jobs.

Remember what happened to the chimps when a smarter-than-chimpanzee species multiplied and dominated the world.

Re: GPT-4

#122

Post by iforgotpassword »

I'd really like to use the openai API for personal projects, but it seems they only offer paying via credit/debit card. Don't really want to get one just for that... :-(

Re: GPT-4

#123

Post by ivalm »

Unclear what's the size but from price ($0.12/1k completion tokens) seems 6x GPT-3, so perhaps 1T parameters...

Re: GPT-4

#124

Post by ttul »

helloplanets wrote: post #92

Asking ChatGPT Plus whether the model it's using is GPT-4 responds with the following: > No, I am not GPT-4. As of March 2023, there is no official announcement or release of GPT-4 by OpenAI. I am an earlier version of the GPT series, specifically a large language model trained by OpenAI. Am I missing something here? Maybe this specific answer (which I'm pretty sure is a prewritten thing on top of the actual LLM) is…

I presume it hasn’t been trained on OpenAI’s latest web site text.

Re: GPT-4

#125

Post by dragonwriter »

mym1990 wrote: post #10

Ugh that testing graph confirms that AP Environmental Science was indeed the easiest AP class and I needn't be proud of passing that exam.

> Ugh that testing graph confirms that AP Environmental Science was indeed the easiest AP class

No, it just indicates that it was the one whose subject matter was best covered by GPT-3.5’s training data.

Re: GPT-4

#126

Post by phphphphp »

Atreiden wrote: post #37

I think it's interesting that they've benchmarked it against an array of standardized tests. Seems like LLMs would be particularly well suited to this kind of test by virtue of it being simple prompt:response, but I have to say...those results are terrifying. Especially when considering the rate of improvement. bottom 10% to top 10% of LSAT in What are the implications for society when general thinking, reading, and…

Passing the LSAT with no time limit and a copy of the training material in front of you is not an achievement. Anybody here could have written code to pass the LSAT. Standardised tests are only hard to solve with technology if you add a bunch of constraints! Standardised tests are not a test of intelligence, they’re a test of information retention — something that technology has been able to out perform humans on for decades. LLMs are a bridge between human-like behaviour and long established technology.

Re: GPT-4

#127

Post by cm2012 »

kroolik wrote: post #110
_boffin_ wrote: post #70

This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the…

My experience has been that the answers are very convincing, but not necessarily true. I would be careful asking gpt questions about abstract knowledge, less about linguistic structure.

They weren't true in past iterations. Since the new version is 10x as accurate (if you believe the test score measures, going from bottom 10% score to top 10%), we're going to see a lot less confident falseness as the tech improves.

Re: GPT-4

#128

Post by f_devd »

attilaberczik wrote: post #109

Prices differences with the last models: ChatGPT API $0.002 per 1k tokens gpt-4 $0.03 per 1k prompt tokens and $0.06 per 1k completion tokens gpt-4 32k context $0.06 per 1k prompt tokens and $0.12 per 1k completion tokens Does completion tokens mean that you also get charged for the answers that the AI gives?

> Does completion tokens mean that you also get charged for the answers that the AI gives?

Seems like it, prompt tokens = input, completion tokens = output

Re: GPT-4

#129

Post by georgelyon »

Does anyone have any context as to how the image understanding works? From what I can gather they are simply using separate text-summarization step to generate some text like "and now we have an image of chicken nuggets" that it then feeds to the text-only network, but I wouldn't be surprised if there is some dialog I'm missing between the previous context and the image understanding mechanism.

Re: GPT-4

#130

Post by 101008 »

_boffin_ wrote: post #70

This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the…

Besides the fact that this comment reads written by GPT itself, using this particular AI as a source for your education is like going to the worse University out there.

I am sure if you always wishes do thave a personal PhD in a particular subject you could find shady universities out there who could provide one without much effort.

[I may be exagerating but the point still stands because the previous user also didn't mean a literal PhD]

Post reply on HN