Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

How does GPT obtain its ability? Tracing emergent abilities of language models

yaofu.notion.site

Post reply on HN
Print view View original

11–20 of 205 posts

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#11

Post by belter »

adamsmith143 wrote: post #4
srajabi wrote: post #2

Amazing insight, particularly section 6. "- The two important but different abilities of GPT-3.5 are *knowledge* and *reasoning*. Generally, it would be ideal if we could *offload the knowledge part to the outside retrieval system and let the language model only focus on reasoning.* This is because: - The model’s internal knowledge is always cut off at a certain time. The model always needs up-to-date knowledge to an…

The problem with ChatGPT's "knowledge" is that it isn't trustworthy. It will happily output very confident sounding nonsense, or blatantly incorrect statements. We need a way to verify how accurate it's outputs are

ChatGPT made this nice COBOL program to create an S3 Bucket,a technical impossibility...

IDENTIFICATION DIVISION. PROGRAM-ID. CREATE-S3-BUCKET.

ENVIRONMENT DIVISION. CONFIGURATION SECTION.

INPUT-OUTPUT SECTION.

DATA DIVISION. FILE SECTION.

WORKING-STORAGE SECTION. 01 AWS-ACCESS-KEY PIC X(20). 01 AWS-SECRET-KEY PIC X(40). 01 BUCKET-NAME PIC X(255).

PROCEDURE DIVISION. CREATE-BUCKET. MOVE AWS-ACCESS-KEY TO AWS-ACCESS-KEY-VAR MOVE AWS-SECRET-KEY TO AWS-SECRET-KEY-VAR MOVE BUCKET-NAME TO BUCKET-NAME-VAR INVOKE AWS-S3 "CREATE-BUCKET" USING AWS-ACCESS-KEY-VAR AWS-SECRET-KEY-VAR BUCKET-NAME-VAR

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#12

Post by 1123581321 »

resource0x wrote: post #6
jimmaswell wrote: post #3

Imagine Wolfram's system with GPT integrated. I hope they're working on that.

Current GPT version is not very good at math, and it's not at all clear whether this can be fixed within a language model. Q: I have 2 cats and 1 horse. How many legs do they have in total? A: If you have two cats and one horse, then the total number of legs they have is 8. Cats typically have four legs, while horses have four legs as well. So two cats would have a total of 8 legs, and when you add the four legs of t…

I've found it gets the math right most of the time in stories. For example:

> Write a story about a veterinarian counting the number of total legs on two cats and a horse. He reports the total number of legs to his assistant so he can write them down.

As the veterinarian entered the examination room, he was greeted by two playful cats and a majestic horse. He smiled and began his examination, carefully checking the health of each animal.

After completing his examinations, the veterinarian turned to his assistant and said, "I need you to write down the total number of legs for these three animals."

The assistant nodded and picked up a pen and paper. "Okay, let's see," the veterinarian said as he counted the legs on the cats. "Each cat has four legs, so that's eight legs for the two cats."

Next, he moved on to the horse. "And this beautiful horse has four legs as well, for a total of twelve legs."

The assistant quickly wrote down the numbers as the veterinarian spoke. "Twelve legs total," the veterinarian confirmed. "Make sure to include that in their medical records."

The assistant nodded and continued to take notes as the veterinarian continued to provide updates on the animals' health. As they finished up the examinations, the veterinarian couldn't help but smile, knowing that he was able to help these wonderful creatures.

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#13

Post by amelius »

sebzim4500 wrote: post #9
resource0x wrote: post #6

Earlier quoted context omitted.

Current GPT version is not very good at math, and it's not at all clear whether this can be fixed within a language model. Q: I have 2 cats and 1 horse. How many legs do they have in total? A: If you have two cats and one horse, then the total number of legs they have is 8. Cats typically have four legs, while horses have four legs as well. So two cats would have a total of 8 legs, and when you add the four legs of t…

It would have got it right if you got it to show its working. That's the trick to doing computations with LLMs, the computation per token is constant so you want to split the computation over many tokens. > I have 2 cats and 1 horse. How many legs do they have in total? show your working. > If you have 2 cats and 1 horse, they would have a total of 10 legs. Cats typically have 4 legs, so 2 cats would have 2 x 4 = >8…

> That's the trick to doing computations with LLMs, the computation per token is constant so you want to split the computation over many tokens.

Could you explain this a bit more? What are LLMs? Why is the number of tokens different in your approach?

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#14

Post by jtxt »

adamsmith143 wrote: post #4
srajabi wrote: post #2

Amazing insight, particularly section 6. "- The two important but different abilities of GPT-3.5 are *knowledge* and *reasoning*. Generally, it would be ideal if we could *offload the knowledge part to the outside retrieval system and let the language model only focus on reasoning.* This is because: - The model’s internal knowledge is always cut off at a certain time. The model always needs up-to-date knowledge to an…

The problem with ChatGPT's "knowledge" is that it isn't trustworthy. It will happily output very confident sounding nonsense, or blatantly incorrect statements. We need a way to verify how accurate it's outputs are

One way I tried to do this is by having it write an answer, and a footnote reference at each fact. [1] then list search terms that be used to verify each claim, then I would respond with the url and quotes from found pages for each one, then have it rewrite the answer based on that information and cite the sources. I think something this direction can be automated. I saw someone do this with math and other tasks, that would talk to a connected program before answering.

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#15

Post by moffkalast »

smallerfish wrote: post #10
resource0x wrote: post #6

Earlier quoted context omitted.

Current GPT version is not very good at math, and it's not at all clear whether this can be fixed within a language model. Q: I have 2 cats and 1 horse. How many legs do they have in total? A: If you have two cats and one horse, then the total number of legs they have is 8. Cats typically have four legs, while horses have four legs as well. So two cats would have a total of 8 legs, and when you add the four legs of t…

It's very reactive to the prompt: > i have 23 horses each with a normal number of legs, along with 14 dogs, each with a normal number of legs. how many legs in total do all of the animals have? > Based on the information you provided, it sounds like you have 23 horses and each horse has 4 legs, and you have 14 dogs and each dog has 4 legs. If that is correct, then the total number of legs among all of the animals wou…

You know funny thing, for comparison I just entered that exact prompt into the 3 gig sized flan-t5 and I get the following:

> The horses have 23 * 4 = 126 legs. The dogs have 14 * 4 = 84 legs. The total number of legs is 126 + 84 = 204. The answer: 204.

Very very similar, but completely wrong results.

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#16

Post by amelius »

resource0x wrote: post #6
jimmaswell wrote: post #3

Imagine Wolfram's system with GPT integrated. I hope they're working on that.

Current GPT version is not very good at math, and it's not at all clear whether this can be fixed within a language model. Q: I have 2 cats and 1 horse. How many legs do they have in total? A: If you have two cats and one horse, then the total number of legs they have is 8. Cats typically have four legs, while horses have four legs as well. So two cats would have a total of 8 legs, and when you add the four legs of t…

Perhaps you can ask GPT about what is wrong in the answer and how it would fix that? This would give a general approach:

Q: [Question]

A: [Answer]

Q: What is wrong in "[Answer]" and how would you fix that?

A: [Improved answer]

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#17

Post by [deleted] »

sebzim4500 wrote: post #9
resource0x wrote: post #6

Earlier quoted context omitted.

Current GPT version is not very good at math, and it's not at all clear whether this can be fixed within a language model. Q: I have 2 cats and 1 horse. How many legs do they have in total? A: If you have two cats and one horse, then the total number of legs they have is 8. Cats typically have four legs, while horses have four legs as well. So two cats would have a total of 8 legs, and when you add the four legs of t…

It would have got it right if you got it to show its working. That's the trick to doing computations with LLMs, the computation per token is constant so you want to split the computation over many tokens. > I have 2 cats and 1 horse. How many legs do they have in total? show your working. > If you have 2 cats and 1 horse, they would have a total of 10 legs. Cats typically have 4 legs, so 2 cats would have 2 x 4 = >8…

[deleted]

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#18

Post by moffkalast »

adamsmith143 wrote: post #4
srajabi wrote: post #2

Amazing insight, particularly section 6. "- The two important but different abilities of GPT-3.5 are *knowledge* and *reasoning*. Generally, it would be ideal if we could *offload the knowledge part to the outside retrieval system and let the language model only focus on reasoning.* This is because: - The model’s internal knowledge is always cut off at a certain time. The model always needs up-to-date knowledge to an…

The problem with ChatGPT's "knowledge" is that it isn't trustworthy. It will happily output very confident sounding nonsense, or blatantly incorrect statements. We need a way to verify how accurate it's outputs are

ChatGPT to be employed in marketing positions immediately.

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#19

Post by kelseyfrog »

srajabi wrote: post #2

Amazing insight, particularly section 6. "- The two important but different abilities of GPT-3.5 are *knowledge* and *reasoning*. Generally, it would be ideal if we could *offload the knowledge part to the outside retrieval system and let the language model only focus on reasoning.* This is because: - The model’s internal knowledge is always cut off at a certain time. The model always needs up-to-date knowledge to an…

See REALM[1] for some older(2 years) work on this idea.

1. https://arxiv.org/abs/2002.08909

Post reply on HN