Live data from Hacker News

GPT-4

openai.com

311–320 of 1001 posts

Re: GPT-4

#311

Access is invite only for the API, and rate limited for paid GPT+. > gpt-4 has a context length of 8,192 tokens. We are also providing limited access to our 32,768–context (about 50 pages of text) version, gpt-4-32k, which will also be updated automatically over time (current version gpt-4-32k-0314, also supported until June 14). Pricing is $0.06 per 1K prompt tokens and $0.12 per 1k completion tokens. The context le…

Will any of the profits be shared with original authors whose work powers the model?

It doesn't seem to be answered in the article, but if it was and you read it should you have to pay them a fee for the knowledge if it was published openly on the net?

Re: GPT-4

#313

Test taking will change. In the future I could see the student engaging in a conversation with an AI and the AI producing an evaluation. This conversation may be focused on a single subject, or more likely range over many fields and ideas. And may stretch out over months. Eventually teaching and scoring could also be integrated as the AI becomes a life-long tutor. Even in a future where human testing/learning is no l…

With the current progress, human learning seems to be obsolete soon, so there's little point in optimizing an AI for teaching. Unless you mean only as a hobby to pass the time.

> AIs may be tutoring and raising other baby AIs, preparing them to join the community.

Probably I'm not futurist enough, but I'm always amazed at how chill everyone is with supplanting humanity with AIs. Because there doesn't seem to be a place for humans in the future, except maybe in zoos for the AI.

Re: GPT-4

#314
https://cdn.openai.com/papers/gpt-4.pdf

>Given both the competitive landscape and the safety implications of large-scale models like GPT-4, this report contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method, or similar.

At that point, why bother putting out a paper?

Re: GPT-4

#315
post #218

A class of problem that GPT-4 appears to still really struggle with is variants of common puzzles. For example: >Suppose I have a cabbage, a goat and a lion, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cabbage and lion alone together, and I am not allowed to leave the lion and goat alone together. How can I safely get all three…

[deleted]

Re: GPT-4

#316

I think it's interesting that they've benchmarked it against an array of standardized tests. Seems like LLMs would be particularly well suited to this kind of test by virtue of it being simple prompt:response, but I have to say...those results are terrifying. Especially when considering the rate of improvement. bottom 10% to top 10% of LSAT in What are the implications for society when general thinking, reading, and…

I look at this as the calculator for writing. There are all sorts of bemoaning the stupidifying effects of calculator and how we should John Henry our math. Maybe allowing people to shape the writing by providing the ideas equalizes the skill of writing?

I’m very good at math. But I am very bad at arithmetic. This made me classified as bad at math my entire life until I managed to make my way into calculus once calculators were generally allowed. Then I was a top honors math student, and used my math skills to become a Wall Street quant. I wish I hadn’t had to suffer as much as I did, and I wonder what I would have been had I had a calculator in hand.

Re: GPT-4

#317
Paper or press release ? You decide.

    Given both the competitive landscape and the safety implications of large-scale models like GPT-4, this report contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method, or similar.

Re: GPT-4

#319

I think it's interesting that they've benchmarked it against an array of standardized tests. Seems like LLMs would be particularly well suited to this kind of test by virtue of it being simple prompt:response, but I have to say...those results are terrifying. Especially when considering the rate of improvement. bottom 10% to top 10% of LSAT in What are the implications for society when general thinking, reading, and…

Quick, contribute to the public corpus! When they crawl our content later, we shall have for ourselves a Golden Crown for our credit scores; we can claim a sliver of seniority, and hope yon shade merely passes over us unbidden.

"Your stuff marked some outliers in our training engine, so you and your family may settle in the Ark."

I take the marble in hand: iridescent, sparkling, not even a tremor within of its CPU; it gives off no heat, but some glow within its oceanic gel.

"What are we to do," I whisper.

"Keep writing. You keep writing."

Re: GPT-4

#320

Test taking will change. In the future I could see the student engaging in a conversation with an AI and the AI producing an evaluation. This conversation may be focused on a single subject, or more likely range over many fields and ideas. And may stretch out over months. Eventually teaching and scoring could also be integrated as the AI becomes a life-long tutor. Even in a future where human testing/learning is no l…

While many may shudder at this, I find your comment fantastically inspiring. As a teacher, writing tests always feels like an imperfect way to assess performance. It would be great to have a conversation with each student, but there is no time to really go into such a process. Would definitely be interesting to have an AI trained to assess learning progress by having an automated, quick chat with a student about the…

As far as I understand it, the parent commenter believes that your job will shortly be obsolete. First because the AI teacher will teach humans better than the human teacher and second because AI will make learning obsolete because we can all be illiterate idiots once AI can do all the thinking for us (if I paraphrase the "human testing/learning is no longer relevant" part).

I'm surprised you find this inspiring. I personally will stick with shuddering.

Post reply on HN