31–40 of 261 posts
Earlier quoted context omitted.
I never saw a scantron at my college. I thought UTAustin was an elite school.
The enrollment at UT Austin is ~50K. No way you can grade that many tests by hand. Source: I went to UT for grad school and was a TA.
Earlier quoted context omitted.
I never saw a scantron at my college. I thought UTAustin was an elite school.
The enrollment at UT Austin is ~50K. No way you can grade that many tests by hand. Source: I went to UT for grad school and was a TA.
An LLM being able to pass your graduate-level exam almost certainly means that your exam is bad. Lots of lazy professors do things like this (true/false and multiple choice answers, very soft questions, etc.), and the presence of GPTs should help them understand that this is not sufficient for evaluating someone's knowledge of a highly technical topic.
When I was growing up in the 2000s, it was required to learn a foreign language in school. I took Spanish but dropped the class after a year, thinking that when I grew up, computers would be able to translate text far better humans could. Would you believe it, transformers were invented ten years later. I wonder if it's worth learning anything anymore.
I truly pity you for thinking that learning a foreign language is a redundant exercise because of machine translation. And besides, though machines may perform well on menus and tax returns, I hardly think them on the cusp of emitting fine translations of great poems or novels.
This is obviously very cool, but at this point — who knows what I’ll say in a year — my concern with these LLMs is that they’re in the uncanny valley. Here’s one passing a very difficult test. Amazing! Now, rely on it to build a nuclear doohickey for a power station or a multi-billion dollar device for CERN or anything really and, well, no. So humans still have to check the output, and now we’re in that situation whe…
This is obviously very cool, but at this point — who knows what I’ll say in a year — my concern with these LLMs is that they’re in the uncanny valley. Here’s one passing a very difficult test. Amazing! Now, rely on it to build a nuclear doohickey for a power station or a multi-billion dollar device for CERN or anything really and, well, no. So humans still have to check the output, and now we’re in that situation whe…
Also today humans need to check the output, code reviews etc. Maybe in the near future humans can just focus on the reviewing and testing part.
This is obviously very cool, but at this point — who knows what I’ll say in a year — my concern with these LLMs is that they’re in the uncanny valley. Here’s one passing a very difficult test. Amazing! Now, rely on it to build a nuclear doohickey for a power station or a multi-billion dollar device for CERN or anything really and, well, no. So humans still have to check the output, and now we’re in that situation whe…
What is an exam? It's an attempt to test that you have consumed and understood large amounts of information and can apply it to novel (ish) situations, but in a very 'sandboxed' way that is just text-in-text-out. That's literally what these systems are specialists in doing.
Is it maybe a bit like saying a driverless car can outperform most human drivers in a time trial on a race track? Not a trivial feat, to be sure, but also not that surprising perhaps once the basics are dialled in.
Earlier quoted context omitted.
Multiple choice and true false questions were fairly common in my undergraduate experience, particularly in first year courses. Often they were Scantron forms for maximum laziness.
I never saw a scantron at my college. I thought UTAustin was an elite school.