Live data from Hacker News

GPT-4

openai.com

301–310 of 1001 posts

Re: GPT-4

#301
post #288

Interesting how quickly we are pushing ahead with obsoleting human cognition. It may bring many benefits, but I wonder if at some point this development should not be decided by society at large instead of a single well-funded entity that is in an arms race with its competitors. This endeavor is ultimately about replacing humanity with a more intelligent entity, after all. Might be that more humans should have a say…

I think it's always a mistake to hope that a business is going to not exploit innovation for their own gain at the expense of society. If we don't want this technology to have huge effects on society, governments will need to regulate it. I doubt that's feasible, but it's more feasible than hoping that Silicon Valley (or any other business) is going to just hold themselves back from releasing world-shaking tech that will make them trillionaires.

Re: GPT-4

#302
These results are extremely impressive and encouraging, but also remember:

> Despite its capabilities, GPT-4 has similar limitations as earlier GPT models. Most importantly, it still is not fully reliable (it “hallucinates” facts and makes reasoning errors).

That's a quote from this announcement. As these models get more and more capable, it's going to become more and more important that we understand when and how they fail. Right now, it seems like we have very little insight into that. It feels more or less random. But that won't fly when these models are asked to do actually important things. And we'll undoubtedly be tempted to make them do those things as their output gets better.

Re: GPT-4

#303
post #218

A class of problem that GPT-4 appears to still really struggle with is variants of common puzzles. For example: >Suppose I have a cabbage, a goat and a lion, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cabbage and lion alone together, and I am not allowed to leave the lion and goat alone together. How can I safely get all three…

[deleted]

Re: GPT-4

#304

Access is invite only for the API, and rate limited for paid GPT+. > gpt-4 has a context length of 8,192 tokens. We are also providing limited access to our 32,768–context (about 50 pages of text) version, gpt-4-32k, which will also be updated automatically over time (current version gpt-4-32k-0314, also supported until June 14). Pricing is $0.06 per 1K prompt tokens and $0.12 per 1k completion tokens. The context le…

Poe.com(by Quora) have gpt4 now, give it a shot

Re: GPT-4

#305
As a long time LLM enjoyer, here is the most insightful take I've seen https://generative.ink/posts/simulators/ but it's not an easy read if you don't already know some stuff about large language models. Read it if you have seen the "stochastic parrot" and "blurry jpeg" explanations and you feel like they are missing the mark.

Re: GPT-4

#306
post #9

summary: 1. GPT4 is multimodal (text + image inputs => text outputs). This is being released piecemeal - with text input first via ChatGPT Plus subscribers https://beta.openai.com/docs/api-reference/generations/creat... , and via API https://beta.openai.com/docs/api-reference/introduction with waitlist ( https://openai.com/waitlist/gpt-4-api ). Image capability released via https://www.bemyeyes.com/ . 2. GPT4 exhibit…

On Page 36[1], the AI can read an image of chicken nuggets being put in the shape of an earth map. And goes on to explain what it is. Key words that came up on me are joke ... mundane ... silly.

This might be because the question the user asked was "Explain this meme". Meme implies a joke that is mundane and silly. These words do seem out of place. I would not describe it as a joke, mundane, and/or silly.

What does everyone else think?

[1] https://cdn.openai.com/papers/gpt-4.pdf#p36

Re: GPT-4

#307
post #10

Ugh that testing graph confirms that AP Environmental Science was indeed the easiest AP class and I needn't be proud of passing that exam.

Funny you claim this, because the AP Environmental Science pass rate is really low compared to other APs, at least it was when I took it. Maybe it's because the quality of the avg test taker was lower, but I'm not especially convinced that this is the case.

Re: GPT-4

#308
post #41

> Given both the competitive landscape and the safety implications of large-scale models like GPT-4, this report contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method, or similar. "Open"

This is like the "free" vs free debate that has been raging for decades and prompted the famous quote "“free” as in “free speech,” not as in “free beer.”".

Re: GPT-4

#310
post #41

> Given both the competitive landscape and the safety implications of large-scale models like GPT-4, this report contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method, or similar. "Open"

What a joke. This is literary as closed as it gets. They don't even tell you how many parameters the model has.

People may criticize Google because they don't release the weights or an API, but at least they publish papers, which allows the field to progress.

Post reply on HN