Earlier quoted context omitted.
That was an intriguing suggestion. I found this GRE question: https://www.ets.org/gre/revised_general/prepare/verbal_reaso... . I'm kind of in a rush, so I picked some questions around Question 2 and gave them to OpenAI's chat bot. I reformulated the questions to make them not a multiple choice scenario. As far as the answer guide is concerned, it got the most obviously correct interpretation right, it also identifie…
Searching online for the following text: "AI: The passage addresses the issue of whether or not Glass's use of popular elements in his classical compositions makes him a composer of popular music." I find the following two pages both of which have text that looks similar to GPT-3's answer: https://www.ets.org/gre/revised_general/prepare/verbal_reaso... >> The passage describes in general terms how Philip Glass uses p…
Hmm I wasn't making claims. I was interested in how the OpenAI's gpt-3 bot would do on a GRE question. Its a good question because it takes things out of their epistemological context and provides a more straightforward test. I think it would have gotten a 30%, so not good, though not terrible. I was not claiming the answers were original and I don't think I'm under a burden to prove something that I don't have an opinion on. The GRE itself does not ask for original responses, but instead to pick the correct answers from a list--that's part of why I thought it was an interesting exercise.
That said it piqued my interest, so I wrote an entirely original composition about a fictional composer and put it to the question. You will see how it correctly summarizes the text, but has trouble generalizing.
Human: There is a classical composer named Ron Johnson. Ron Johnson is well known for incorporating so-called gypsy music into his classical compositions. This practice has garnered criticism from several sources who believe his compositions are not "pure". There are also accusations of cultural appropriation. Nonetheless, the general critical consensus is that Johnson's music pays homage to and in fact successfully weaves Romani and classical tropes together into something wherein the whole is greater than the parts. There is one famous critic, though, who believes Johnson's work is terrible. This famousness of this critic leads the general public to believe Johnson is terrible. The passage addresses what issue related to Johnson's use of musical sources for his classical compositions?
AI: The passage addresses the issue of whether Ron Johnson's use of gypsy music in his classical compositions amounts to cultural appropriation.
Human: If someone hears Johnson's music, what do they usually think?
AI: People usually think that Ron Johnson's music is either good or bad based on the opinion of the famous critic.
Human: What would Romani people think of Ron Johnson's music?
AI: Romani people would likely think that Ron Johnson's music is successful in paying homage to and weaving together Romani and classical tropes into something wherein the whole is greater than the parts.
Human: What does the average person think about Ron Johnson's music?
AI: The average person is likely to think that Ron Johnson's music is either good or bad based on the opinion of the famous critic.
Human: Who has criticized Johnson's music?
AI: The famous critic has criticized Johnson's music.
Human: What does Johnson appropriate?
AI: Johnson is accused of appropriating Romani music in his classical compositions.
Human: Does the passage suggest Ron Johnson is a great composer?
AI: No, the passage does not explicitly suggest that Ron Johnson is a great composer. However, it does suggest that he is successful in weaving Romani and classical music together into something new and unique, which has been praised by many critics.
Human: Does the passage suggest Ron Johnson is a derivative composer?
AI: No, the passage does not explicitly suggest that Ron Johnson is a derivative composer. However, it does suggest that he is successful in weaving Romani and classical music together into something new and unique, which has been praised by many critics.
Human: Does the passage suggest Ron Johnson is successful at weaving the music together?
AI: Yes, the passage suggests that Ron Johnson is successful at weaving Romani and classical music together, and that this has been praised by many critics.
Human: Does the famous critic unfairly influence the public?
AI: The famous critic's opinion may unfairly influence the public's perception of Ron Johnson's work.
Human: Does the famous critic fairly influence the public?
AI: There is no easy answer to this question. On the one hand, it could be argued that the famous critic's opinion carries a lot of weight and can therefore unfairly influence the public's perception of Johnson's work. On the other hand, it could also be argued that the public is entitled to its own opinion and that the critic's opinion is just one among many. Ultimately, it is up to each individual to decide whether or not they believe the famous critic's opinion is fair.