Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4

openai.com

Post reply on HN
Print view View original

631–640 of 1001 posts

Re: GPT-4

#631

Post by tippytippytango »

amelius wrote: post #595
hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

> As a professional...why not do this? Because your clients do not allow you to share their data with third parties?

This is the biggest thing holding gpt back. Everyone with meaningful data has their hands tied behind their back. So many ideas and the answer is “we can’t put that data in gpt” very frustrating.

Re: GPT-4

#632

Post by m3affan »

hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

The power openai will hold above everyone else is just too much. They will not allow their AI as a service without data collection. That will be a big pill to swallow for the EU.

Re: GPT-4

#633

Post by sprobertson »

DubiousPusher wrote: post #622

Dude said something like "you could hook this up to a calculator". Anyone know if that is implying this generation of model could interface with some kind of symbol processor? Or is he just saying, "in theory", there could be a model that did that? The math seems much improved and it would be a cool trick if it were emulating a symbol processor under the hood. But humans can do that and we opt for calculators and com…

He likely meant techniques such as ToolFormer[1] where the language model will output a "request" (in some text syntax) that another system can parse, run and report back.

[1] https://arxiv.org/abs/2302.04761

Re: GPT-4

#635

Post by LordDragonfang »

jddj wrote: post #571
Imnimo wrote: post #218

A class of problem that GPT-4 appears to still really struggle with is variants of common puzzles. For example: >Suppose I have a cabbage, a goat and a lion, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cabbage and lion alone together, and I am not allowed to leave the lion and goat alone together. How can I safely get all three…

Silk silk silk silk silk silk. What do cows drink?

Tested this on chaptgpt and learned something:

>CGPT: While it is common to believe that cows drink milk, in reality, cows actually drink water.[...]

>Me: So you're saying that no cow drinks milk? [thinking I got it, since baby cows drink milk]

>CGPT: That's correct. While cows do produce milk, they don't drink milk themselves. Cow's milk is primarily consumed by humans, and some young calves are fed milk for a short period of time before they are weaned onto solid food and start drinking water like adult cows.

>Me: Is a calf a cow?

>CGPT: No, a calf is not a cow. A calf is a young bovine animal, usually less than a year old, that has not yet reached maturity. Once a calf reaches maturity and is able to reproduce, it is considered a cow if it is female, or a bull or steer if it is male.

>Cows are adult female bovine animals that have given birth to at least one calf. They are typically used for dairy production, breeding, and sometimes for meat production. So while a calf and a cow are both members of the same species, they refer to different stages of life.

Re: GPT-4

#636

Post by acchow »

Imnimo wrote: post #218

A class of problem that GPT-4 appears to still really struggle with is variants of common puzzles. For example: >Suppose I have a cabbage, a goat and a lion, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cabbage and lion alone together, and I am not allowed to leave the lion and goat alone together. How can I safely get all three…

The short answer is that GPT doesn't "reason".

Re: GPT-4

#637

Post by [deleted] »

amelius wrote: post #595
hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

> As a professional...why not do this? Because your clients do not allow you to share their data with third parties?

[deleted]

Re: GPT-4

#638

Post by fatihcelikbas »

amelius wrote: post #595
hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

> As a professional...why not do this? Because your clients do not allow you to share their data with third parties?

How about open-source models like Flan-T5? What stops you from using them in your own cloud account or better on-prem?

Re: GPT-4

#639

Post by yeetard »

snackwalrus wrote: post #300
nealabq wrote: post #227

Test taking will change. In the future I could see the student engaging in a conversation with an AI and the AI producing an evaluation. This conversation may be focused on a single subject, or more likely range over many fields and ideas. And may stretch out over months. Eventually teaching and scoring could also be integrated as the AI becomes a life-long tutor. Even in a future where human testing/learning is no l…

There was blog post on HN recently about the upbringings of great scientists, physicists, polymaths, etc. They almost invariably had access to near unlimited time with high quality tutors. He cited a source that claimed modern students who had access to significant tutoring resources were very likely to be at the top of their class. Personalized learning is highly effective. I think your idea is an exciting one indee…

true also:https://en.wikipedia.org/wiki/Bloom's_2_sigma_problem

Re: GPT-4

#640

Post by ChatGTP »

silverlake wrote: post #385
Imnimo wrote: post #218

A class of problem that GPT-4 appears to still really struggle with is variants of common puzzles. For example: >Suppose I have a cabbage, a goat and a lion, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cabbage and lion alone together, and I am not allowed to leave the lion and goat alone together. How can I safely get all three…

I also tested logic puzzles tweaked to avoid memorization. GPT3 did poorly, GPT4 got a few of them. I expect humans will still be useful until GPT6 solves all these problems.

Within about 6 months ?
Post reply on HN