Solving Math Word Problems
openai.com
Solving Math Word Problems
1–10 of 18 posts
Re: Solving Math Word Problems
#2[deleted]
Re: Solving Math Word Problems
#3Scoring 55% on a test like this should not be considered a great accomplishment. A sign of progress, yes, but not an accomplishment by itself.
This is still simply a system that is good at guessing. It does not know anything.
Re: Solving Math Word Problems
#4> Richard, Jerry, and Robert are going to share 60 cherries. If Robert has 30 cherries, and has 10 more than Richard, how many more cherries does Robert have than Jerry?
> answer:
> Robert has 30 + 10 = 40 cherries.
> If there are 60 cherries to be shared, then Richard and Jerry will have 60 - 40 = 20 cherries each.
> Robert has 40 - 20 = 20 more cherries than Jerry.
Um, the answer is "correct" but isn't the actual reasoning wrong?
Robert has 30
Richard has 20
Jerry has 10
Hence they split the 60 this way.
Re: Solving Math Word Problems
#5Scoring 55% on a test like this should not be considered a great accomplishment. A sign of progress, yes, but not an accomplishment by itself. This is still simply a system that is good at guessing . It does not know anything.
> It does not know anything.
I would argue that it "knows" an awful lot, but it can't actually reason with it.
However impressive GPT3 type models are, I am not particularly convinced that they're much more than glorified hashtables.
If the hash table is large enough, it can produce lot of answers to a lot of questions, or approximately imitate a lot of stuff it's seen before.
Whether it can actually combine "knowledge" it has stored in its weights into a pattern it's never seen before ... I'm not convinced.
Re: Solving Math Word Problems
#6> Richard, Jerry, and Robert are going to share 60 cherries. If Robert has 30 cherries, and has 10 more than Richard, how many more cherries does Robert have than Jerry? > answer: > Robert has 30 + 10 = 40 cherries. > If there are 60 cherries to be shared, then Richard and Jerry will have 60 - 40 = 20 cherries each. > Robert has 40 - 20 = 20 more cherries than Jerry. Um, the answer is "correct" but isn't the actual r…
This is some "Sideways stories from Wayside School" logic here. (https://wayside-school.fandom.com/wiki/Joe_(book_chapter))
> This doesn’t make any sense. When I count the wrong way I get the right answer, and when I count right I get the wrong answer.
---------
The other story this reminds me of is Abbot and Costello's "7 x 13 == 28" skit.
Re: Solving Math Word Problems
#7Scoring 55% on a test like this should not be considered a great accomplishment. A sign of progress, yes, but not an accomplishment by itself. This is still simply a system that is good at guessing . It does not know anything.
> It does not know anything. I would argue that it "knows" an awful lot, but it can't actually reason with it. However impressive GPT3 type models are, I am not particularly convinced that they're much more than glorified hashtables. If the hash table is large enough, it can produce lot of answers to a lot of questions, or approximately imitate a lot of stuff it's seen before. Whether it can actually combine "knowled…
Re: "Glorified Hastable"
There is a 1-1 correspondence between data compression and generative models. GPT-2 is a highly effective loseless data compression tool: https://bellard.org/textsynth/sms.html
Always wondered why this insight is not taught as much, especially in the context of things like dimensionality reduction...
Re: Solving Math Word Problems
#8> Richard, Jerry, and Robert are going to share 60 cherries. If Robert has 30 cherries, and has 10 more than Richard, how many more cherries does Robert have than Jerry? > answer: > Robert has 30 + 10 = 40 cherries. > If there are 60 cherries to be shared, then Richard and Jerry will have 60 - 40 = 20 cherries each. > Robert has 40 - 20 = 20 more cherries than Jerry. Um, the answer is "correct" but isn't the actual r…
Looks like it randomly applies operations and reasonings rather than read the text. This sentence for example makes no sense and shows this AI has no understanding of numbers whatsoever, not even first grade level understanding:
> If there are 60 cherries to be shared, then Richard and Jerry will have 60 - 40 = 20 cherries each.
Re: Solving Math Word Problems
#9Scoring 55% on a test like this should not be considered a great accomplishment. A sign of progress, yes, but not an accomplishment by itself. This is still simply a system that is good at guessing . It does not know anything.
GEOS (2015) scores 49% on SAT problems and it is in geometry
https://www.semanticscholar.org/paper/Solving-Geometry-Probl...
You were good at guessing!
Re: Solving Math Word Problems
#10Scoring 55% on a test like this should not be considered a great accomplishment. A sign of progress, yes, but not an accomplishment by itself. This is still simply a system that is good at guessing . It does not know anything.
GEOS (2015) scores 49% on SAT problems and it is in geometry https://www.semanticscholar.org/paper/Solving-Geometry-Probl... You were good at guessing!
SAT problems are multiple choice, with 5 options. So 50% is barely twice random guessing (1/5).
See how far randomly guessing an integer 1-1000 gets you with OP's word problems with freeform responses.