Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4

openai.com

Post reply on HN
Print view View original

861–870 of 1001 posts

Re: GPT-4

#861

Post by three14 »

jsheard wrote: post #468
Imnimo wrote: post #218

A class of problem that GPT-4 appears to still really struggle with is variants of common puzzles. For example: >Suppose I have a cabbage, a goat and a lion, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cabbage and lion alone together, and I am not allowed to leave the lion and goat alone together. How can I safely get all three…

A funny variation on this kind of over-fitting to common trick questions - if you ask it which weighs more, a pound of bricks or a pound of feathers, it will correctly explain that they actually weigh the same amount, one pound. But if you ask it which weighs more, two pounds of bricks or a pound of feathers, the question is similar enough to the trick question that it falls into the same thought process and contorts…

Maybe it knows the answer, but since it was trained on the internet, it's trolling you.

Re: GPT-4

#862

Post by choeger »

How do these models handle renaming? E.g.,

"Let foo be the function that calculates the sinus of its first argument. Let bar be the circumference of a circle with radius one. What is the value of foo applied to bar?

Re: GPT-4

#863

Post by marsven_422 »

hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

"expand the reasoning" there is no reasoning going on here!

It's all statistical word generation aka math!

And this is not how humans "work" our brain are not computers running software. We are something else.

Re: GPT-4

#864

Post by creatonez »

d3ckard wrote: post #600
hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

I must have missed the part when it started doing anything algorithmically. I thought it’s applied statistics, with all the consequences of that. Still a great achievement and super useful tool, but AGI claims really seem exaggerated.

What do you mean by "algorithmically"? Gradient descent of a neural network can absolutely create algorithms. It can approximate arbitrary generalizations.

Re: GPT-4

#865

Post by geraneum »

soheil wrote: post #756
aabajian wrote: post #456

I'll be finishing my interventional radiology fellowship this year. I remember in 2016 when Geoffrey Hinton said, "We should stop training radiologists now," the radiology community was aghast and in-denial. My undergrad and masters were in computer science, and I felt, "yes, that's about right." If you were starting a diagnostic radiology residency, including intern year and fellowship, you'd just be finishing now.…

I also wonder how many AI startups doing medical vision will now go under.

None, unless “Open”AI really opens up about how and if their LLM can actually interpret the images like in their marketing material. We’re talking about medicine and a ton of regulations.

Re: GPT-4

#866

Post by regulation_d »

OkGoDoIt wrote: post #533

From the livestream video, the tax part was incredibly impressive. After ingesting the entire tax code and a specific set of facts for a family and then calculating their taxes for them, it then was able to turn that all into a rhyming poem. Mind blown. Here it is in its entirety: --- In the year of twenty-eighteen, Alice and Bob, a married team, Their income combined reached new heights, As they worked hard day and…

> After ingesting the entire tax code…

According to a quick google search, the entirety of the US tax code is over 1M words. I wonder which number GPT will support a prompt that large.

Re: GPT-4

#867

Post by __MatrixMan__ »

Wow, it's way smarter. I've been querying GPT-3 about this problem all day (I'm not a go dev, I just have go problems):

https://gist.github.com/MatrixManAtYrService/ac040f60d3602fc...

GPT-4 took the buggy file, took the error message, and spat out a non-buggy file (well, ok, it took one revision). That's miles ahead GPT-3, which I've asked about this problem several times today.

Re: GPT-4

#868

Post by adamcharnock »

00F_ wrote: post #705
Sol- wrote: post #288

Interesting how quickly we are pushing ahead with obsoleting human cognition. It may bring many benefits, but I wonder if at some point this development should not be decided by society at large instead of a single well-funded entity that is in an arms race with its competitors. This endeavor is ultimately about replacing humanity with a more intelligent entity, after all. Might be that more humans should have a say…

every other day i am reminded about the state of AI and i feel complete despair. why do people not realize exactly what you just said, that this endeavor is ultimately about replacing humanity? what other long-term result could the concept of AI possibly have? its like the biggest mass psychosis that has ever existed. whenever i talk to people about this, they always parrot the same thing almost word for word: people…

I agree that this really could signal a massive shift in our society. But I’m also seeing people conflate humanity with jobs and productivity. And while I don’t have evidence for it, this feels to me like a rather North American proclivity.

Yes knowledge worker jobs may significantly suffer, but that is far from being ‘humanity’.

It seems to me that professions that involve interacting with the real world could go largely untouched (dentists, factory workers, delivery people, drivers, anyone working with nature).

Of course, feel free to hit me up with your counter-arguments!

Re: GPT-4

#869

Post by Hoyadonis »

amrb wrote: post #715
hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

HIPAA fines will sink you so fast, unless they be hosting it dedicated.

If they redact all identifying information, it would most likely be legally Kosher. However, there is an extreme abundance of caution in the healthcare industry regarding everything surrounding HIPAA. Merely questioning the legality of something can cost millions of dollars in lawyers' fees. Therefore even miniscule chances of something being legally challenged (e.g. plugging patient information into an LLM) would most likely be deemed too risky. And frankly, hospital administrators will not want to risk their careers over trying out what they perceive to be a glorified chatbot.

Tl;dr: When it comes to HIPAA, risk aversion is the name of the game.

Re: GPT-4

#870

Post by smashers1114 »

choeger wrote: post #862

How do these models handle renaming? E.g., "Let foo be the function that calculates the sinus of its first argument. Let bar be the circumference of a circle with radius one. What is the value of foo applied to bar?

Just tested it out and got the following:

=========

To find the value of foo applied to bar, we need to first determine the values of both foo and bar. Let's start with bar, the circumference of a circle with radius 1:

Circumference (C) = 2 * π * r where r is the radius.

In this case, r = 1, so:

bar = C = 2 * π * 1 = 2π

Now, let's move on to foo. Since foo is a function that calculates the sinus of its first argument, we need to find the sine of bar (2π):

foo(bar) = sin(2π)

The sine function is periodic with a period of 2π, which means that sin(2π) is equal to sin(0). The value of sin(0) is 0. Therefore:

foo(bar) = sin(2π) = 0

======= So I think it evaluated correctly here unless I have made a dumb mistake in reading your prompt myself.

Post reply on HN