Live data from Hacker News

I quiz ChatGPT about math

billwadge.com

31–40 of 96 posts

Re: I quiz ChatGPT about math

#31
>Does every set have a measure?

>Not every set has a measure. In order for a set to have a measure, it must satisfy certain properties, such as being countably infinite or having a well-defined notion of “size” or “length.” For example, the set of real numbers has a measure (namely, its Lebesgue measure), but the set of all subsets of the real numbers does not have a measure. In general, only certain types of sets can be assigned a measure in a meaningful way.

This response is just nonsense. Very interestingly the question is phrased using colloquial terminology and ChatGPT answers in a way where it talks about the colloquial phrase as if it were real mathematical terminology, in turn getting extremely confused and making stuff up.

(The reason the response is wrong is because the central point is lost. Being measurable is a property of the measure. ChatGPT claims some set isn't measurable while not naming under which measure, which is just nonsense. In fact the real numbers might "have no measure" e.g. under the empty measure and the set of all subsets of the real numbers might "have a measure" e.g. under the counting measure.)

Re: I quiz ChatGPT about math

#32
post #12

Here's a very easy middle school competition problem - https://imgur.com/a/YdFSBVY It repeatedly got the answer wrong. I engaged in a long conversation with it (too long to post) where I tried to convince it that its answer was wrong, but it became quite rude at a certain point & alleged I was trying to trick it or something (?!) so I just gave up. Unfortunately, I was doing the whole exercise in front of my 10 year…

You should basically be thinking of chatGPT as a personal Wikipedia. It has the collective knowledge of the internet. It can still be wrong about fact based questions, but is a good starting point. It’s not effective at doing math because that’s not what it was designed to do.

If I post that same question on Wikipedia and confidently assert the answer is 1, some good Samaritan will edit it within a day & say no dumbass its 6, and then link me to the Talk page & we'll duke it out over there. On ChatGPT, you have no recourse other than the thumb down button. When you give it the right answer it simply refuses to accept! It's sure amusing as an adult, but be aware that several schools (atleast here in the midwest) are discussing this in the classroom - my kid said his teacher was talking about ChatGPT and that's why I proceeded to show what it does. So kids might be quite confused by this behavior. Better to just go with the standard disclaimer "I don't know. As a large language model trained by ClosedAI blah blah blah insert boilerplate here, I can't figure out the answers to basic equations mankind has known for a few centuries now unless more VC money forthcoming. Ask Powell to pause his ratehikes and market shoots back up, we staff up the org with few mathematicians and they'll tell you its 6. Right now its 1, suck it dummy"

Re: I quiz ChatGPT about math

#33
post #14

Anyone who has bothered to cut through the hype of ChatGPT, would already have realised that it isn't smart at math and is only regurgitating the results that it has been already been trained on and will present it to you to make itself 'appear' intelligent. It doesn't even know why it is gives you the wrong answer even when it is presenting the generated output as correct. Like what another commenter said, it has li…

Nobody has hyped chatGPT as being good at math

Re: I quiz ChatGPT about math

#34
post #15

I was actually very impressed with some math questions it was able to answer for me: S: If flabb means three, snabb means four, and whabb mean five, what is flabb plus whabb? If flabb means three, snabb means four, and whabb means five, then flabb plus whabb would be equal to three plus five, or eight. In this made-up numbering system, the words “flabb,” “snabb,” and “whabb” represent the numbers three, four, and fiv…

> There are a few reasons why people may argue about the answer to a mathematical question like “8 / 2(2+2)”. One reason is that there is more than one wav to interpret the question and arrive at a different answer. For example, some people may interpret the question as “8 / (2 * (2+2))” and arrive at an answer of 1, while others mav interpret it as “(8 / 2) * (2+2)” and arrive at an answer of 16.

Wow, this is kinda astonishing. Could it ruminate about the precedence of the operators?

Also: the words "may" and "way" appear as "mav" and "wav" in your text. Is this a problem with your input to the HN comment or did the model really make these textual errors?

Re: I quiz ChatGPT about math

#35
post #15

I was actually very impressed with some math questions it was able to answer for me: S: If flabb means three, snabb means four, and whabb mean five, what is flabb plus whabb? If flabb means three, snabb means four, and whabb means five, then flabb plus whabb would be equal to three plus five, or eight. In this made-up numbering system, the words “flabb,” “snabb,” and “whabb” represent the numbers three, four, and fiv…

That is very cool, and surprising to me given I was also initially underwhelmed. One nitpick though: in the second question, although the explanation itself is clean, there appear to be seven b’s in its representation of the number six.

> This is just one possible way to represent six in this numbering system, and there may be other ways to do it as well.

Gotta hand it to ChatGPT. It's not wrong.

Re: I quiz ChatGPT about math

#36
post #32

Earlier quoted context omitted.

You should basically be thinking of chatGPT as a personal Wikipedia. It has the collective knowledge of the internet. It can still be wrong about fact based questions, but is a good starting point. It’s not effective at doing math because that’s not what it was designed to do.

If I post that same question on Wikipedia and confidently assert the answer is 1, some good Samaritan will edit it within a day & say no dumbass its 6, and then link me to the Talk page & we'll duke it out over there. On ChatGPT, you have no recourse other than the thumb down button. When you give it the right answer it simply refuses to accept! It's sure amusing as an adult, but be aware that several schools (atleas…

Well my point is there aren't pages for specific math problems on wikipedia, because that's not the goal of wikipedia. ChatGPT can tell you the rules of algebra, but it's bad at applying them. If you want to solve math problems you should go to wolframalpha.

My personal opinion is that having an encyclopedia that is sometimes wrong is actually incredibly valuable for educating people in the social media age. Distinguishing between content that is true and content that sounds true is a skill that used to be unneeded but is now essentially a requirement to productively participate in society. ChatGPT seems like a decent way to train that skill.

Re: I quiz ChatGPT about math

#37
After reading so much here and this , about chatGPT- I have a feeling what will be needed for AI- is teachers.

As it gets smarter and actually gets better reasoning, and capability- the way to keep AI sane and kind, will be to try to teach it like a person, with it putting importance on lessons from designated teachers even more, than it's weight in casual conversation , generally.

I think i forsee teachers being hired to teach AI, not just humans. Though how much AI will benefit from it will depend on their level But we'll have to get to that point first, as i read attempts to teach ChatGPT having odd results , which of course reveal what it can't do-yet.

At some point, we're going to have to intentionally educate AI- i feel like giving them knowledge in a similar manner is not talked about enough, even if some feel teaching AI like we do people isn't necessary due to AI's other abilities

I don't think i've seen others here consider the idea of seeing the o

Re: I quiz ChatGPT about math

#38
post #15

I was actually very impressed with some math questions it was able to answer for me: S: If flabb means three, snabb means four, and whabb mean five, what is flabb plus whabb? If flabb means three, snabb means four, and whabb means five, then flabb plus whabb would be equal to three plus five, or eight. In this made-up numbering system, the words “flabb,” “snabb,” and “whabb” represent the numbers three, four, and fiv…

[deleted]

Re: I quiz ChatGPT about math

#39
I just tried doing this myself

JFZ: how do we know there are infinitely many primes

ChatGPT: One way to show that there are infinitely many prime numbers is to use the fact that the set of prime numbers is infinite to show that there must be an infinite number of composite numbers as well. Composite numbers are positive integers that have at least one positive integer divisor other than 1 and itself. For example, 4 is a composite number because it can be divided by 2 (and is not prime), and 6 is a composite number because it can be divided by 2 and 3 (and is not prime).

To show that there are infinitely many composite numbers, consider the sequence of numbers 2, 4, 6, 8, 10, 12, 14, 16, and so on. Each of these numbers is composite because it can be divided by 2. Now consider the sequence of numbers 3, 6, 9, 12, 15, 18, 21, 24, and so on. Each of these numbers is composite because it can be divided by 3. And so on. For every prime number, there is an infinite sequence of composite numbers that can be generated by multiplying that prime number by other positive integers.

Since there are infinite sequences of composite numbers, and each composite number is the product of at least two prime numbers (for example, 12 is the product of 2 and 6, which are both prime numbers), there must be an infinite number of prime numbers as well. This is one way to show that there are infinitely many prime numbers, though there are other ways to prove it as well.

(seems hand wavey, and probably wrong though I can't figure out where the flaw is)

JFZ: is A5 a solvable group

Yes, the group A5 (also known as the alternating group on 5 elements) is a solvable group. A group is solvable if it can be constructed from simpler groups using only group extensions and group quotients, and if it has a composition series in which each factor is a simple group. (wrong)

The group A5 is the group of even permutations of five objects. It has 60 elements, and it is isomorphic to the group of rotations of a regular dodecahedron. A5 is a simple group, which means that it has no proper normal subgroups (subgroups that are normal in the group but not equal to the group itself). This means that A5 cannot be constructed from simpler groups using group extensions or group quotients. However, it can be shown that A5 has a composition series in which each factor is a simple group, so it is solvable.

In general, many groups that arise in mathematics and physics are solvable, and the study of solvable groups is an important area of research in group theory.

Re: I quiz ChatGPT about math

#40
post #15

I was actually very impressed with some math questions it was able to answer for me: S: If flabb means three, snabb means four, and whabb mean five, what is flabb plus whabb? If flabb means three, snabb means four, and whabb means five, then flabb plus whabb would be equal to three plus five, or eight. In this made-up numbering system, the words “flabb,” “snabb,” and “whabb” represent the numbers three, four, and fiv…

> If flabb means three, snabb means four, and whabb means five, then flabb plus whabb would be equal to three plus five, or eight. In this made-up numbering system, the words “flabb,” “snabb,” and “whabb” represent the numbers three, four, and five, respectively. When these numbers are added together, the result is the number eight.

Was its training model a freshman university student trying to get through a 10 page essay?

Post reply on HN