GPT-4 could pass bar exam, AI researchers say
the-decoder.com
GPT-4 could pass bar exam, AI researchers say
1–10 of 167 posts
Re: GPT-4 could pass bar exam, AI researchers say
#2Bar exam down. Medical next?
While GPT-3 wasn't advanced enough for cracking medical exam, it was used for notable contributions. For e.g. this is an interesting 2021 paper about "Medically Aware GPT-3 as a Data Generator" - https://aclanthology.org/2021.nlpmc-1.9.pdf
Would love to see if GPT-4 is advanced enough to take medical exam.
Re: GPT-4 could pass bar exam, AI researchers say
#3I want to perform some research of my own on which exams chatGPT can and can't do. It's multilingual, so can people from outside the UK (I already know where to get those) point me at some example exams and marking schemes? Any level, not just top.
Currently have Polish school maths: https://news.ycombinator.com/item?id=34205732
Re: GPT-4 could pass bar exam, AI researchers say
#4How soon before this qualifies as a public defender? Gonna put this on my dystopia bingo.
Re: GPT-4 could pass bar exam, AI researchers say
#5How long until it's smart enough to be a judge?
Re: GPT-4 could pass bar exam, AI researchers say
#6How soon before this qualifies as a public defender? Gonna put this on my dystopia bingo.
Defender is probably good. Prosecutor is what would worry me, given I don't know better than to blindly trust the meme that the average person commits 6 felonies before breakfast.
Re: GPT-4 could pass bar exam, AI researchers say
#7fwiw I had my dad ask ChatGPT relatively high-level questions about his field of practice in the state he is licensed in. Some were very good answers but that some were wildly off. The ones that seemed to be better were questions about a concept (ie "What is x concept in law") while the incorrect ones were the ones asking for specifics ("What is the statute of limitations for x in y state").
Re: GPT-4 could pass bar exam, AI researchers say
#8How long until it's smart enough to be a judge?
I don't know about judge but it could probably outperform most of Congress at this point.
Re: GPT-4 could pass bar exam, AI researchers say
#9Sounds like they didn't have access to GPT-4, but "Based on anecdotal evidence"... they still predict this.
Re: GPT-4 could pass bar exam, AI researchers say
#10Wonder how data biases will surface