Now rephrase the questions and try again.
GPT-4 gets a B on my quantum computing final exam
61–70 of 261 posts
Re: GPT-4 gets a B on my quantum computing final exam
#62Re: GPT-4 gets a B on my quantum computing final exam
#63This is obviously very cool, but at this point — who knows what I’ll say in a year — my concern with these LLMs is that they’re in the uncanny valley. Here’s one passing a very difficult test. Amazing! Now, rely on it to build a nuclear doohickey for a power station or a multi-billion dollar device for CERN or anything really and, well, no. So humans still have to check the output, and now we’re in that situation whe…
I also don't think it's going to a be lineair growth. 4 is really good, but for writing 3.5 gave better results in some cases.
And if you really dive deep you see 4 really hasn't any deep understanding and makes obvious mistakes. I think they've also explicitly trained it for tests.
Re: GPT-4 gets a B on my quantum computing final exam
#64Look, it's impressive yes or yes but is it that surprising that a system like an LLM does well on exams? What is an exam? It's an attempt to test that you have consumed and understood large amounts of information and can apply it to novel (ish) situations, but in a very 'sandboxed' way that is just text-in-text-out. That's literally what these systems are specialists in doing. Is it maybe a bit like saying a driverle…
It’s impressive and surprising. Imagine going back to the year 2021 and telling the good people of HN that in 2023 AI would be as advanced like it is now. Literally no one would have believed you in 2021 if you did.
The knee-jerk contrarianism seems to be in vogue right now. Reminds me of some colleagues in 2007 lamenting about the iPhone, "It's not that great; it doesn't even have copy & paste!" Fast forward a few years, and no blackberries in sight.
Re: GPT-4 gets a B on my quantum computing final exam
#65When I was growing up in the 2000s, it was required to learn a foreign language in school. I took Spanish but dropped the class after a year, thinking that when I grew up, computers would be able to translate text far better humans could. Would you believe it, transformers were invented ten years later. I wonder if it's worth learning anything anymore.
The cool thing about learning a new language really well, is that it creates a new world.
You get to learn words that describe things that your mother tongue can’t.
Just like a programming language? Some things are easy and other things are hard to express depending if you use LISP or Python.
I believe it’s the same with spoken languages. Some thoughts are easy to articulate, other hard. And it’s cool to shift language depending on what you want to articulate.
Re: GPT-4 gets a B on my quantum computing final exam
#66I tried the first one on GPT-3.5-turbo and it got the answer wrong haha. Goes to show you how much better GPT-4 is... GPT-3.5-TURBO: --------------------------- True. A pure state of n qubits is described by an n-dimensional complex unit vector, also known as a quantum state vector. In Dirac notation, a pure state of n qubits can be represented as: |ψ⟩ = a_0|0⟩ + a_1|1⟩ + ... + a_(2^n-1)|2^n-1⟩ where a_i are complex…
I assume thhere is tech out there to have an AI co-pilot for quantum programming, I hope so!
Re: GPT-4 gets a B on my quantum computing final exam
#67I've been re-engineering the pre-screening process for two companies (one F500, one startup) to account for LLMs. The trick (for now) is to include subtle clues that LLMs will miss but savvy/experienced humans will notice and incorporate into the answer. The goal of pre-screening is to knock-out the bottom 80-90% of candidates who are "perfectly decent" but not actually good enough to survive a battery of interviews.
Re: GPT-4 gets a B on my quantum computing final exam
#68Earlier quoted context omitted.
I never saw a scantron at my college. I thought UTAustin was an elite school.
The enrollment at UT Austin is ~50K. No way you can grade that many tests by hand. Source: I went to UT for grad school and was a TA.
Well, if a uni with 5k enrolled can hand grade tests, then obviously UT Austin could, if they had 10x faculty of the first uni.
Re: GPT-4 gets a B on my quantum computing final exam
#69Earlier quoted context omitted.
Also today humans need to check the output, code reviews etc. Maybe in the near future humans can just focus on the reviewing and testing part.
Humans are going to want to do the worst parts of the job?
Would we even still be able to? If we stop learning how to code (because AI does that for us) we might not be very good reviewers.
Re: GPT-4 gets a B on my quantum computing final exam
#70Look, it's impressive yes or yes but is it that surprising that a system like an LLM does well on exams? What is an exam? It's an attempt to test that you have consumed and understood large amounts of information and can apply it to novel (ish) situations, but in a very 'sandboxed' way that is just text-in-text-out. That's literally what these systems are specialists in doing. Is it maybe a bit like saying a driverle…
It’s impressive and surprising. Imagine going back to the year 2021 and telling the good people of HN that in 2023 AI would be as advanced like it is now. Literally no one would have believed you in 2021 if you did.
Exactly everything is obvious in hindsight.
No one called this, and certainly no one called it would be so easy to access.