Live data from Hacker News

GPT-4

openai.com

231–240 of 1001 posts

Re: GPT-4

#231

It is amazing how this crowd in HN reacts to AI news coming out of OpenAI compared to other competitors like Google or FB. Today there was another news about Google releasing their AI in GCP and mostly the comments were negative. The contrast is clearly visible and without any clear explanation for this difference I have to suspect that maybe something is being artificially done to boost one against the other.

The only thing Google "released" was an announcement of a waiting list, that as of a few hours ago twitter folk claimed didn't even exist yet

Re: GPT-4

#232
It's a surprise that GPT-4 could improve so much in maths, especially GPT 3.5 didn't seem to understand many word problems correctly. For example, ChatGPT still struggle with this very simple problem, how GPT-4 could do much better is for me a bit of mystery:

Mina has a mix of boxes, some yellow and some purple. She sorts 27 greeting cards into the boxes, putting exactly 3 cards into each yellow box, and 7 cards into each purple box. How many purple boxes does Mina have? (After tried from 3 to 10, it gave up and said the problem is not solvable. In another run, it mimicked a correct strategy but messed up totally by division. Only in one run, it got the answer correctly.)

I can not wait to test it out.

Re: GPT-4

#233

From the paper: > Given both the competitive landscape and the safety implications of large-scale models like GPT-4, this report contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method, or similar. I'm curious whether they have continued to scale up model size/compute significantly or if they have managed to make significant innovati…

I bet they use CLIP to caption the image and feed the text of the caption into GPT, but that's just a guess.

Re: GPT-4

#234

Access is invite only for the API, and rate limited for paid GPT+. > gpt-4 has a context length of 8,192 tokens. We are also providing limited access to our 32,768–context (about 50 pages of text) version, gpt-4-32k, which will also be updated automatically over time (current version gpt-4-32k-0314, also supported until June 14). Pricing is $0.06 per 1K prompt tokens and $0.12 per 1k completion tokens. The context le…

$0.12 per 1k completion tokens is high enough that it makes it prohibitively expensive to use the 32k context model. Especially in a chatbot use case with cumulative prompting, which is the best use case for such a large context vs. the default cheaper 8k window. In contrast, GPT-3.5 text-davinci-003 was $0.02/1k tokens, and let's not get into the ChatGPT API.

I would imagine most usecases for the 32k model have much longer prompts than completions, so the $0.06 per prompt token will be the real problem. I can't think of a usecase yet, but that might be because I haven't got a sense of how smart it is.

Re: GPT-4

#235
Today's submarine from the NYT is hilariously unintentionally unflattering, did someone even proof read this? https://www.nytimes.com/2023/03/14/technology/openai-new-gpt...

  Mnemonics to learn basic words:
  Hola:"Hola, cola" - sounds like "cola" (Coke)
  Adiós: "Adiós, my toes" - rhymes with "toes"
  Gracias: "Gracias, grassy ass" - sounds like "grassy ass"
  Mañana: "Mañana, banana" - rhymes with "banana"
  Uno: "Uno, you know" - sounds like "you know"
  Tres: "Tres, dress" - rhymes with "dress"

  Conjugation of the verbs:
  Ser (To be)

  • Yo soy
  • Tú eres
  • Él/Ella/Usted es
  • Nosotros/Nosotras somos
  • Ellos/Ellas/Ustedes son

Re: GPT-4

#237
It astonishes me that we've reached almost exactly the type of artificial intelligence used by the fictional computers in Star Trek: The Next Generation. I didn't think that would happen in my lifetime. What's next?!

Re: GPT-4

#238

I think it's interesting that they've benchmarked it against an array of standardized tests. Seems like LLMs would be particularly well suited to this kind of test by virtue of it being simple prompt:response, but I have to say...those results are terrifying. Especially when considering the rate of improvement. bottom 10% to top 10% of LSAT in What are the implications for society when general thinking, reading, and…

It's almost like they're trying to ruin society or be annihilated by crushing regulation. I'm glad that I got a college degree before these were created because now everything is suspect. You can't trust that someone accomplished something honestly now that cheating is dead simple. People are going to stop trusting and using tech unless something changes.

The software industry is so smart that it's stupid. I hope it was worth ruining the internet, society, and your own jobs to look like the smartest one in the room.

Re: GPT-4

#239
>ChatGPT Plus subscribers will get GPT-4 access on chat.openai.com with a usage cap

Signing up for ChatGPT Plus seems to be the most realistic way to get access right now.

Re: GPT-4

#240

I think it's interesting that they've benchmarked it against an array of standardized tests. Seems like LLMs would be particularly well suited to this kind of test by virtue of it being simple prompt:response, but I have to say...those results are terrifying. Especially when considering the rate of improvement. bottom 10% to top 10% of LSAT in What are the implications for society when general thinking, reading, and…

[deleted]
Post reply on HN