Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

How does GPT obtain its ability? Tracing emergent abilities of language models

yaofu.notion.site

Post reply on HN
Print view View original

41–50 of 205 posts

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#41

Post by lossolo »

srajabi wrote: post #2

Amazing insight, particularly section 6. "- The two important but different abilities of GPT-3.5 are *knowledge* and *reasoning*. Generally, it would be ideal if we could *offload the knowledge part to the outside retrieval system and let the language model only focus on reasoning.* This is because: - The model’s internal knowledge is always cut off at a certain time. The model always needs up-to-date knowledge to an…

For anyone interested it's called retrieval transformer. Here is example of one from Google: RETRO[1][2]

1. https://arxiv.org/abs/2112.04426

2. https://jalammar.github.io/illustrated-retrieval-transformer...

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#42

Post by [deleted] »

resource0x wrote: post #6
jimmaswell wrote: post #3

Imagine Wolfram's system with GPT integrated. I hope they're working on that.

Current GPT version is not very good at math, and it's not at all clear whether this can be fixed within a language model. Q: I have 2 cats and 1 horse. How many legs do they have in total? A: If you have two cats and one horse, then the total number of legs they have is 8. Cats typically have four legs, while horses have four legs as well. So two cats would have a total of 8 legs, and when you add the four legs of t…

[deleted]

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#43

Post by resource0x »

Can anyone explain why the GPT response to the same question 4 days ago is different from today's:

[ 4 days ago] > Can I learn to sing like Pavarotti?

It is possible to learn to sing like Pavarotti, but it will require a lot of practice, dedication, and training. Pavarotti was a renowned opera singer known for his incredible vocal range, powerful voice, and technical mastery. He had many years of training and experience, and he worked tirelessly to develop his talent and hone his skills. If you are interested in learning to sing like Pavarotti, the best thing to do is to find a qualified vocal coach who can provide you with guidance and support as you work on your singing. With dedication and hard work, you can develop your talent and improve your skills.

[today] > can I learn to sing like Pavarotti?

Pavarotti was a legendary opera singer known for his incredible vocal range and technique. While it is certainly possible to learn to sing like him with proper training and dedication, it would be a challenging undertaking. Singing well requires a combination of natural talent, proper technique, and a lot of practice. If you are interested in learning to sing, it would be best to start by finding a good vocal coach who can help you develop your skills and find your own unique voice.

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#44

Post by skybrian »

resource0x wrote: post #43

Can anyone explain why the GPT response to the same question 4 days ago is different from today's: [ 4 days ago] > Can I learn to sing like Pavarotti? It is possible to learn to sing like Pavarotti, but it will require a lot of practice, dedication, and training. Pavarotti was a renowned opera singer known for his incredible vocal range, powerful voice, and technical mastery. He had many years of training and experie…

Not sure which GPT you mean, but if you just run it twice in a row you'll likely get a different response too. There is usually some randomness and how much depends on settings.

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#45

Post by palata »

visarga wrote: post #34
adamsmith143 wrote: post #4

Earlier quoted context omitted.

The problem with ChatGPT's "knowledge" is that it isn't trustworthy. It will happily output very confident sounding nonsense, or blatantly incorrect statements. We need a way to verify how accurate it's outputs are

You are right, this is the pain point - trust, verification. I think it will become the next focus of research. There are many things we could do to solve this problem. One of them is to use an external reference for verification. Another one is to train the model to verify facts by augmenting the input with lies - adversarial training for lie detection. Problem solving can be improved by generating more data with th…

> There are many things we could do to solve this problem.

Just like what social networks have failed to do in years? Not sure it's that simple :-)

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#46

Post by lossolo »

visarga wrote: post #34
adamsmith143 wrote: post #4

Earlier quoted context omitted.

The problem with ChatGPT's "knowledge" is that it isn't trustworthy. It will happily output very confident sounding nonsense, or blatantly incorrect statements. We need a way to verify how accurate it's outputs are

You are right, this is the pain point - trust, verification. I think it will become the next focus of research. There are many things we could do to solve this problem. One of them is to use an external reference for verification. Another one is to train the model to verify facts by augmenting the input with lies - adversarial training for lie detection. Problem solving can be improved by generating more data with th…

Sure but you can only verify facts like "when was born?", you can verify this today easily with knowledge database but that's not what is interesting in ChatGPT, what's interesting is what it can generate which you can't easily fact check, like "generate me a poem in style of and ", how can you verify that the style is correct automatically? or "write me code that connects to not public system and does ", how can you verify if this code works properly without access to that system and ability to run it yourself?

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#47

Post by skybrian »

page_severian wrote: post #23
resource0x wrote: post #6

Earlier quoted context omitted.

Current GPT version is not very good at math, and it's not at all clear whether this can be fixed within a language model. Q: I have 2 cats and 1 horse. How many legs do they have in total? A: If you have two cats and one horse, then the total number of legs they have is 8. Cats typically have four legs, while horses have four legs as well. So two cats would have a total of 8 legs, and when you add the four legs of t…

These errors are common and important to note. Though what I find fascinating is how often I can prompt engineer around these errors by telling GPT to just be smarter and think more carefully. Just tried the following for instance. Q: You are a master logician, who can solve all manner of language problems and have excellent math skills. I have 2 cats and 1 horse. How many legs do they have in total? Show your reason…

Yes, this certainly helps. I find it ironic that you can get somewhat better results for nonfiction by giving it more clues about what it's supposed to be pretending to be. It's always pretending, though.

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#48

Post by resource0x »

skybrian wrote: post #44
resource0x wrote: post #43

Can anyone explain why the GPT response to the same question 4 days ago is different from today's: [ 4 days ago] > Can I learn to sing like Pavarotti? It is possible to learn to sing like Pavarotti, but it will require a lot of practice, dedication, and training. Pavarotti was a renowned opera singer known for his incredible vocal range, powerful voice, and technical mastery. He had many years of training and experie…

Not sure which GPT you mean, but if you just run it twice in a row you'll likely get a different response too. There is usually some randomness and how much depends on settings.

Sometimes the meaning of the response is totally different.

[ 4 days ago ] The son of my father, but not my brother. Who is he?

If a person is the son of the speaker's father but is not the speaker's brother, then that person is the speaker's nephew. A nephew is the son of a person's sibling, so if the speaker's father has a son who is not the speaker's brother, that person is the speaker's nephew. For example, if the speaker has a brother named John and John has a son named David, then David is the speaker's nephew. He is the son of the speaker's father, but not the speaker's brother.

[today] The son of my father, but not my brother. Who is he?

The son of your father but not your brother would be your half-brother. A half-brother is a brother who shares only one parent with you, rather than both. For example, if your father had a child with another woman before he had you, that child would be your half-brother.

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#49

Post by [deleted] »

aeternum wrote: post #27
adamsmith143 wrote: post #4

Earlier quoted context omitted.

The problem with ChatGPT's "knowledge" is that it isn't trustworthy. It will happily output very confident sounding nonsense, or blatantly incorrect statements. We need a way to verify how accurate it's outputs are

Whose knowledge is trustworthy? We've somehow come to associate certain institutions or scientific authorities with truth when that is about the furthest from real science: "Have no respect whatsoever for authority; forget who said it and instead look what he starts with, where he ends up, and ask yourself, Is it reasonable?" -Richard P. Feynman "One of the great commandments of science is, "Mistrust arguments from a…

[deleted]

Re: How does GPT obtain its ability? Tracing emergent abilities of language models

#50

Post by belter »

lmm wrote: post #29
belter wrote: post #11

Earlier quoted context omitted.

ChatGPT made this nice COBOL program to create an S3 Bucket,a technical impossibility... IDENTIFICATION DIVISION. PROGRAM-ID. CREATE-S3-BUCKET. ENVIRONMENT DIVISION. CONFIGURATION SECTION. INPUT-OUTPUT SECTION. DATA DIVISION. FILE SECTION. WORKING-STORAGE SECTION. 01 AWS-ACCESS-KEY PIC X(20). 01 AWS-SECRET-KEY PIC X(40). 01 BUCKET-NAME PIC X(255). PROCEDURE DIVISION. CREATE-BUCKET. MOVE AWS-ACCESS-KEY TO AWS-ACCESS-K…

How is that impossible? Plenty of libraries are available for COBOL, especially if you use COBOL.NET

What is the COBOL SDK for AWS?
Post reply on HN