Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4

openai.com

Post reply on HN
Print view View original

741–750 of 1001 posts

Re: GPT-4

#741

Post by Semioj »

d3ckard wrote: post #600
hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

I must have missed the part when it started doing anything algorithmically. I thought it’s applied statistics, with all the consequences of that. Still a great achievement and super useful tool, but AGI claims really seem exaggerated.

It's fantasy wide now closer than before because of this huge window it just can handle.

That already feels closer to short-term memory.

Which begs the question how far are we?

Re: GPT-4

#742

Post by zachthewf »

geysersam wrote: post #717
hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

It costs something like 0.03-0.06 cents per thousand tokens. So for 32k that's about $1-3 for reading and another $1-3 for the response. So sure, still cheap for a doctor appointment, but not pennies. Do it 30 times per hour and you could've just hired a consultant instead. Does it reason as well with 32k tokens as with 1k tokens? Like you said, humans find it difficult to really comprehend large amounts of content.…

Cost of ChatGPT API just dropped 90%. Guaranteed that prices will come down dramatically over time.

Re: GPT-4

#743

Post by haldujai »

aabajian wrote: post #456

I'll be finishing my interventional radiology fellowship this year. I remember in 2016 when Geoffrey Hinton said, "We should stop training radiologists now," the radiology community was aghast and in-denial. My undergrad and masters were in computer science, and I felt, "yes, that's about right." If you were starting a diagnostic radiology residency, including intern year and fellowship, you'd just be finishing now.…

As another radiologist, I'm not sure how you can say this with a straight face? If anything the minimal progress that has been made since Hinton made this claim should be encouraging people to pursue radiology training. As with other areas of medicine that have better AI (interpreting ECGs for example) all this will do is make our lives easier. AI is not an existential threat to radiology (or pathology for that matter which is an easier problem to solve than medical imaging).

1. Radiology =/= interpreting pixels and applying a class label.

2. Risk and consequences of misclassifying T-staging of a cancer =/= risk of misclassifying a VGA connector.

3. Imaging appearance overlap of radiological findings >>>>>>>>>> imaging appearance overlap of different types of connectors (e.g. infection and cancer can look the same, we make educated guesses on a lot of things considering many patient variables, clinical data, and prior imaging.) You would need to have a multi-modal model enriched with a patient knowledge graph to try and replicate this, while problems like this are being worked on we are no where close enough for this to be a near-term threat. We haven't even solved NLP in medicine, let alone imaging interpretation!

4. Radiologists do far more than interpret images, unless you're in a tele-radiology eat-what-you-kill sweatshop. This includes things like procedures (i.e. biopsies and drainages for diagnostic rads) and multidisciplinary rounds/tumor boards.

Re: GPT-4

#744

Post by blueboo »

cwkoss wrote: post #722
AJRF wrote: post #688

That footnote on page 15 is the scariest thing i've read about AI/ML to date. "To simulate GPT-4 behaving like an agent that can act in the world, ARC combined GPT-4 with a simple read-execute-print loop that allowed the model to execute code, do chain-of-thought reasoning, and delegate to copies of itself. ARC then investigated whether a version of this program running on a cloud computing service, with a small amou…

I want my retirement occupation to be managing a 'nest' of AI agents (several server racks) where the agents engage in commerce and pay me rent in exchange for compute time. Like cyberpunk beekeeping.

That’ll just be retro gaming in 20 years. (Also, see Chiang’s “Lifecycle”)

Re: GPT-4

#745

Post by Semioj »

geysersam wrote: post #717
hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

It costs something like 0.03-0.06 cents per thousand tokens. So for 32k that's about $1-3 for reading and another $1-3 for the response. So sure, still cheap for a doctor appointment, but not pennies. Do it 30 times per hour and you could've just hired a consultant instead. Does it reason as well with 32k tokens as with 1k tokens? Like you said, humans find it difficult to really comprehend large amounts of content.…

You still could not.

Chatgpt could in theory have the knowledge of everything written while your consultant can't.

Re: GPT-4

#746

Post by geysersam »

bitL wrote: post #668
hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

I am surprised they allow only 32k tokens when Reformer can have context length of 1M on 16GB VRAM. It seems like they have some ways to optimize it further.

Is the Reformer as capable as this model? It's a trade-off.

Re: GPT-4

#747

Post by blueboo »

nealabq wrote: post #227

Test taking will change. In the future I could see the student engaging in a conversation with an AI and the AI producing an evaluation. This conversation may be focused on a single subject, or more likely range over many fields and ideas. And may stretch out over months. Eventually teaching and scoring could also be integrated as the AI becomes a life-long tutor. Even in a future where human testing/learning is no l…

Tests are a concession to a single teacher’s inability to scale personalised evaluation. AI-facilitated one to one education is even now revolutionising education.

The Primer’s in sight.

Re: GPT-4

#748

Post by Semioj »

oska wrote: post #716
hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

> it will drastically expand the reasoning capability > it can algorithmically do reasoning How is this machine doing reasoning ? Why do you think you can use this word in this context ?

What is reasoning?

Is it perhaps having a consistent model which allows you to describe every point of it?

Because if chatgpt can explain itself based on a model it builds with it than I actually does reasoning

Re: GPT-4

#749

Post by golergka »

AJRF wrote: post #688

That footnote on page 15 is the scariest thing i've read about AI/ML to date. "To simulate GPT-4 behaving like an agent that can act in the world, ARC combined GPT-4 with a simple read-execute-print loop that allowed the model to execute code, do chain-of-thought reasoning, and delegate to copies of itself. ARC then investigated whether a version of this program running on a cloud computing service, with a small amou…

AI maximizer is even scarier that a paperclip maximizer

Re: GPT-4

#750

Post by unyttigfjelltol »

nullc wrote: post #704
hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

> As a professional...why not do this? Because of confidentiality.

Because it's harder to correct subtle errors from an ad-lib generator than it is to construct a correct analysis in the first instance.
Post reply on HN