Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4

openai.com

Post reply on HN
Print view View original

131–140 of 1001 posts

Re: GPT-4

#131

Post by Scarblac »

Atreiden wrote: post #37

I think it's interesting that they've benchmarked it against an array of standardized tests. Seems like LLMs would be particularly well suited to this kind of test by virtue of it being simple prompt:response, but I have to say...those results are terrifying. Especially when considering the rate of improvement. bottom 10% to top 10% of LSAT in What are the implications for society when general thinking, reading, and…

A difference with chess is that chess engines try to play the best move, and GPT the most likely text.

Re: GPT-4

#132

Post by weird-eye-issue »

minimaxir wrote: post #98
teruakohatu wrote: post #26

Access is invite only for the API, and rate limited for paid GPT+. > gpt-4 has a context length of 8,192 tokens. We are also providing limited access to our 32,768–context (about 50 pages of text) version, gpt-4-32k, which will also be updated automatically over time (current version gpt-4-32k-0314, also supported until June 14). Pricing is $0.06 per 1K prompt tokens and $0.12 per 1k completion tokens. The context le…

$0.12 per 1k completion tokens is high enough that it makes it prohibitively expensive to use the 32k context model. Especially in a chatbot use case with cumulative prompting, which is the best use case for such a large context vs. the default cheaper 8k window. In contrast, GPT-3.5 text-davinci-003 was $0.02/1k tokens, and let's not get into the ChatGPT API.

I disagree that out of all possible use cases for a large context model that a chatbot is really the "best use case".

Re: GPT-4

#133

Post by LawTalkingGuy »

Kaibeezy wrote: post #57

I've been wondering what happens to Turnitin (ubiquitous academic plagiarism detector) now that students can cheat using infinite bespoke rather than finite pre-existing material. Just a few weeks ago they released a tool to "detect" ChatGPT. Obsolete already? https://www.turnitin.com/blog/sneak-preview-of-turnitins-ai-...

Schools are obsolete if they want to use these tools.

The world has changed and their job is to prepare students for it.

Re: GPT-4

#134

Post by weird-eye-issue »

nickrubin wrote: post #58

This is huge: "Rather than the classic ChatGPT personality with a fixed verbosity, tone, and style, developers (and soon ChatGPT users) can now prescribe their AI’s style and task by describing those directions in the 'system' message."

This has been possible already...

Re: GPT-4

#135

Post by ftxbro »

Its GRE verbal is only 169/170? These guys need to realize that statistical language modeling can only get us so far, and we need real research in the underlying mechanistic and symbolic methods to begin to approach human level cognition. Also I'm an AI skeptic, which means that I don't think that AI should be used in politics, law, or medicine.

Re: GPT-4

#136

Post by ml_basics »

From the paper:

> Given both the competitive landscape and the safety implications of large-scale models like GPT-4, this report contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method, or similar.

I'm curious whether they have continued to scale up model size/compute significantly or if they have managed to make significant innovations there.

I just skimmed the paper but seems they are also omitting details about how they actually feed the images in too, which is a shame as a curious outside observer.

Re: GPT-4

#138

Post by AndrewKemendo »

Imagine ingesting the contents of the internet as though it's a perfect reflection of humanity, and then building that into a general purpose recommendation system. That's what this is

Is the content on the internet what we should be basing our systematic thinking around?

No, I think this is the lazy way to do it - by using commoncrawl you've enshrined the biases and values of the people who are commenting and providing text to the internet into the recommendation system which will be impacting all other systems which integrate it

Congratulations, you made 4Chan into the borg

Re: GPT-4

#139

Post by _boffin_ »

andrepd wrote: post #102
_boffin_ wrote: post #70

This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the…

But it often produces wrong information. If you don't know the subject (since you are learning), how do you distinguish between correct information and incorrect but very plausible-sounding information?

Although the technology occasionally produces incorrect information, I still find it to be a helpful learning tool. I break down the information into bullet points and cross-check it with other sources to differentiate between accurate and inaccurate information--I know this isn't infallible. One of the advantages of using this technology is that it often presents me with new and intriguing information, which I might not have found otherwise. This allows me to ask new questions and explore the subject matter more profoundly, resulting in a better understanding and an opportunity to create a mental model.

Re: GPT-4

#140

Post by la64710 »

It is amazing how this crowd in HN reacts to AI news coming out of OpenAI compared to other competitors like Google or FB. Today there was another news about Google releasing their AI in GCP and mostly the comments were negative. The contrast is clearly visible and without any clear explanation for this difference I have to suspect that maybe something is being artificially done to boost one against the other.
Post reply on HN