41–50 of 75 posts
Noting that the Github repo includes a data pipeline for instruction fine tunining. What's the difference between this and other data pipelines like Alpaca?
Aren't you Greg Diamos, the founder, why are you asking this instead of answering?
I’m really curious to see how someone who hasn’t been staring at the docs for weeks would explain it.
Earlier quoted context omitted.
You can't ask ChatGPT to count something and expect that it can answer correctly, because it does not have counting logic. It is a language model, not a math model. People use this to "prove" hallucinations, but when you ask it something that is within it's programmed abilities, you get something at least close to what you want. Having said that, here are the words ChatGPT gave me for the same prompt: Magi Nagi Sagi…
It's true that ChatGPT is not designed for counting and struggles with it in general. But my point was that ChatGPT, like any tokenized LLM, doesn't even have the concept of letters. The prompt "how many e's in this sentence" is rendered as the tokens [4919, 867, 304, 338, 287, 428, 6827]. There just isn't a pathway for it to consider the letters that make up those tokens. I'm a little surprised it did that well on y…
Earlier quoted context omitted.
It's a fair criticism, and ChatGPT does better, but this isn't a great test of model quality. All LLMS that rely on tokenization struggle with being introspective on language. Try asking chatGPT to count how many e's are in a sentence, or to list all words that start with "to" and end wide "de". I haven't heard anyone describe the phenomenon clearly, but I expect it is a challenge with reasoning over both intent of t…
You can't ask ChatGPT to count something and expect that it can answer correctly, because it does not have counting logic. It is a language model, not a math model. People use this to "prove" hallucinations, but when you ask it something that is within it's programmed abilities, you get something at least close to what you want. Having said that, here are the words ChatGPT gave me for the same prompt: Magi Nagi Sagi…
Earlier quoted context omitted.
Could you not have at least Googled the word before speaking against it? https://www.google.com/search?q=stagi There are a lot of genuine hits for stagi.
those are either family or brand names. I don’t see it used as a common word in any of the results.
Earlier quoted context omitted.
You can't ask ChatGPT to count something and expect that it can answer correctly, because it does not have counting logic. It is a language model, not a math model. People use this to "prove" hallucinations, but when you ask it something that is within it's programmed abilities, you get something at least close to what you want. Having said that, here are the words ChatGPT gave me for the same prompt: Magi Nagi Sagi…
Chat GPT does have counting logic. The math model is encoded inside of the language model.
Congrats! I went to your demo and asked for words that end in agi. This is what I got: -- agi, agi, agi, agi, agi, agi, agi These are some of the words that end in agi. You can also use the word agi in a sentence. For example, "I am going to the grocery store to get some agi." These are some of words that end in agi. These are some words that end in agi. maximize, maximize, maximize, maximize, maximize, maximize, max…
It's a fair criticism, and ChatGPT does better, but this isn't a great test of model quality. All LLMS that rely on tokenization struggle with being introspective on language. Try asking chatGPT to count how many e's are in a sentence, or to list all words that start with "to" and end wide "de". I haven't heard anyone describe the phenomenon clearly, but I expect it is a challenge with reasoning over both intent of t…
There are 7 instances of the letter 'e' in the sentence: "Try asking chatGPT to count how many e's are in a sentence."
another one:
The words with the letter 'e' from the sentence "Try asking chatGPT to count how many e's are in a sentence" are:
asking
sentence
Here are some English words containing three instances of the letter 'e':
Nevertheless
Extreme
Relevance
Precedence
Residence
Easement
Demeanor
What surprising here is that it's still capable of writing hundred lines of python code..
Earlier quoted context omitted.
It's true that ChatGPT is not designed for counting and struggles with it in general. But my point was that ChatGPT, like any tokenized LLM, doesn't even have the concept of letters. The prompt "how many e's in this sentence" is rendered as the tokens [4919, 867, 304, 338, 287, 428, 6827]. There just isn't a pathway for it to consider the letters that make up those tokens. I'm a little surprised it did that well on y…
In a prompt, can you just tell the model which letters make up each token? Eg a list of ag = a g etc. I imagine a dictionary of that for all tokens in the training data would help.
Earlier quoted context omitted.
To be fair the question did not specify the language and included a disclaimer about it.
Even if you don't consider an Italian word as a word: It's a last name. It's a brand name. It is several companies' name. It belongs in the list just fine.
Earlier quoted context omitted.
Chat GPT does have counting logic. The math model is encoded inside of the language model.
This needs citation. These are not the same things. It will get numerical references right if it has sources used in the model, but it isn't doing any numerical calculations.
"6769545085823578960 + 16027170449476717488"
ChatGPT said the answer is 22796715535300296448. It got the correct answer even though the problem wasn't in its training data.