ChatGPT scores 80% on SAT reading/writing with collective chain of thought
1–10 of 126 posts
Re: ChatGPT scores 80% on SAT reading/writing with collective chain of thought
#2Using chain of thought [slightly modified] example from https://arxiv.org/abs/2201.11903 (ref'd in OP)
Prompt:
Q: Roger has 5 tennis balls. He buys 2 more cans of tennis balls. Each can has 3 tennis balls. How many tennis balls does he have now?
A: Roger started with 5 balls. 2 cans of 3 tennis balls each is 6 tennis balls. 5 + 6 = 11. The answer is 11.
Q: The room has 19 chairs. We are using 10 and then bought 9 more, how many chairs do we have in the room?
response
A: The room started with 19 chairs. We are using 10 of them, so we have 19 - 10 = 9 chairs left in the room. We then bought 9 more chairs, bringing the total number of chairs in the room to 9 + 9 = 18 chairs.
-- next prompt
[include all above]
We read that and say: Thank goodness, the Homo sapiens are safe! Can you guess why we say that?
response
I'm sorry, I'm not sure why you would say "Thank goodness, the Homo sapiens are safe!" in response to the question about the number of chairs in the room. The question and answer do not have any relation to the safety of Homo sapiens. Can you please provide more information about the context or reasoning behind your statement?
Re: ChatGPT scores 80% on SAT reading/writing with collective chain of thought
#3Maybe chatGPT should do an MFA in poetry next, it sounds like it’d do well on the GRE ;-)
Re: ChatGPT scores 80% on SAT reading/writing with collective chain of thought
#4I think this is evidence against the usefulness of standardized tests rather than support for ChatGPT
Re: ChatGPT scores 80% on SAT reading/writing with collective chain of thought
#5[deleted]
Re: ChatGPT scores 80% on SAT reading/writing with collective chain of thought
#6I think this is evidence against the usefulness of standardized tests rather than support for ChatGPT
Why? This section is literally just questions about a modestly complex reading passage. It’s the most real world part of the SAT.
Re: ChatGPT scores 80% on SAT reading/writing with collective chain of thought
#7Maybe ChatGPT should host an AMA
Re: ChatGPT scores 80% on SAT reading/writing with collective chain of thought
#8Using chain of thought [slightly modified] example from https://arxiv.org/abs/2201.11903 (ref'd in OP) Prompt: Q: Roger has 5 tennis balls. He buys 2 more cans of tennis balls. Each can has 3 tennis balls. How many tennis balls does he have now? A: Roger started with 5 balls. 2 cans of 3 tennis balls each is 6 tennis balls. 5 + 6 = 11. The answer is 11. Q: The room has 19 chairs. We are using 10 and then bought 9 mor…
Not so fast...
https://www.learngpt.com/posts/the-room-has-19-chairs-we-are...
Edit: even better: https://www.learngpt.com/posts/the-room-has-19-chairs-we-are...
Re: ChatGPT scores 80% on SAT reading/writing with collective chain of thought
#9ChatGPT could easily get 100% on the Mathematics sections, but I never thought it'd get 80% on the reading/writing section.
Re: ChatGPT scores 80% on SAT reading/writing with collective chain of thought
#10Using chain of thought [slightly modified] example from https://arxiv.org/abs/2201.11903 (ref'd in OP) Prompt: Q: Roger has 5 tennis balls. He buys 2 more cans of tennis balls. Each can has 3 tennis balls. How many tennis balls does he have now? A: Roger started with 5 balls. 2 cans of 3 tennis balls each is 6 tennis balls. 5 + 6 = 11. The answer is 11. Q: The room has 19 chairs. We are using 10 and then bought 9 mor…
Not so fast... https://www.learngpt.com/posts/the-room-has-19-chairs-we-are... Edit: even better: https://www.learngpt.com/posts/the-room-has-19-chairs-we-are...
And answer from the new version:
> After using 10 chairs, we have 19 chairs - 10 chairs = 9 chairs in the room. Then after buying 9 more chairs, we have 9 chairs + 9 chairs = 18 chairs in the room.