Earlier quoted context omitted.
You won't need people for that once AI systems start improving themselves.
So who will then certify them?
It's AI all the way down...
GPT-4 gets a B on my quantum computing final exam
111–120 of 261 posts
Re: GPT-4 gets a B on my quantum computing final exam
#112Re: GPT-4 gets a B on my quantum computing final exam
#113Earlier quoted context omitted.
Hospitals would love to fire all radiologists and replace them with software. They've already done it with outsourcing; a large chunk of what used to be done entirely in-house has been contracted out to remote overseas doctors.
What is outsourced to overseas doctors today? I'm assuming you're talking about the US. From what I understand it isn't even possible generally to see a doctor remotely in a cheaper state, because medical licensing is per-state.
Medical Scans are reviewed abroad. This practice started in Dentistry in the 90s/early 2000s but expanded to Radiological scans as well. At this point most CT, MRI, and XRay scans in the US have a first pass analysis done by doctors in India+Pakistan.
Medical billing has also been offshored to India+Pakistan btw
In general, a lot of back office Dental+Medical functions were outsourced in the 2000s+2010s.
Eg. Paper about this from 2006 - https://ipc.mit.edu/sites/default/files/2019-01/06-005.pdf
Re: GPT-4 gets a B on my quantum computing final exam
#114Earlier quoted context omitted.
I agree with the point you're making here, but it’s also funny that the description of someone passing a test but not being able to do much without a lot of human supervision is… exactly the description of a human college graduate.
Can anyone answer the chance that example tests of these questions were in its training set? And it's just regurgitating the answers someone else wrote? As I imagine it's a very high chance given how much uni lecturers recycle exam questions. When I was at uni you could just get the last 5 years worth of questions from the library for almost any subject and guess what the questions were probably going to be. Often th…
Yes, the vast majority of these questions are standard known problems it definitely already saw with a slightly different formulation.
Re: GPT-4 gets a B on my quantum computing final exam
#115This is obviously very cool, but at this point — who knows what I’ll say in a year — my concern with these LLMs is that they’re in the uncanny valley. Here’s one passing a very difficult test. Amazing! Now, rely on it to build a nuclear doohickey for a power station or a multi-billion dollar device for CERN or anything really and, well, no. So humans still have to check the output, and now we’re in that situation whe…
>No negativity towards AI here. It’s amazing and it’ll change the future. But we need to be careful on the way. Yeah, I suspect a lot of fields will have a similar trajectory to how AI has impacted radiology. It might catch the tumor in 99.9999% of cases, better than any human doctor. But missing a malignant tumor 0.0001% of the time is unacceptable, because it spikes the hospital's malpractice costs. So every single…
>It might catch the tumor in 99.9999% of cases, better than any human doctor. But missing a malignant tumor 0.0001% of the time is unacceptable, because it spikes the hospital's malpractice costs. So every single scan still has to be reviewed manually by a doctor first, then by the AI as a fallback.
I find it hard to believe human doctors miss malignant tumors in less than 1 out of every 10 million cases.
Re: GPT-4 gets a B on my quantum computing final exam
#116Re: GPT-4 gets a B on my quantum computing final exam
#117Earlier quoted context omitted.
I don't get why people are so optimistic about machine translation. Computers can get explicit meaning across – that's obvious to anyone who understands linear algebra, information theory, and linguistics. But many aspects of translation (puns, tone, cultural context) aren't just about mapping from one vector space to another. A human, no matter how fluently bilingual, would have to think about the problem, and the c…
>no machine translation system currently in existence could translate the 逆転裁判 games to Ace Attorney games Maybe it's already in the training set, but GPT-4 does give that exact translation. I've found that GPT-4 is exceptionally good at translating idioms and other big picture translation issues. Where it occasionally makes mistakes is with small grammatical and word order issues that previous tools do tend to get r…
> Maybe it's already in the training set, but GPT-4 does give that exact translation.
The corpus includes Wikipedia, so yes, it's in there. That's the kind of thing I'd expect it to be good at, along with idioms, when the model gets large enough.
I meant that no machine translation system could translate the games. Thanks to an early localisation decision, you have to do more than just translate words into words for this series, making it a hard problem: https://en.wikipedia.org/wiki/Phoenix_Wright:_Ace_Attorney
> While the original version of the game takes place in Japan, the localization is set in the United States; this became an issue when localizing later games, where the Japanese setting was more obvious.
Among other things, translators have to choose which Japanese elements to keep and which to replace with US equivalents, while maintaining internal consistency with the localisation decisions of previous games. Doing a good job requires more than just linguistic competence: there's nothing you could put in the corpus to give a GPT-style system the ability to perform this task.
Re: GPT-4 gets a B on my quantum computing final exam
#118Look, it's impressive yes or yes but is it that surprising that a system like an LLM does well on exams? What is an exam? It's an attempt to test that you have consumed and understood large amounts of information and can apply it to novel (ish) situations, but in a very 'sandboxed' way that is just text-in-text-out. That's literally what these systems are specialists in doing. Is it maybe a bit like saying a driverle…
It’s impressive and surprising. Imagine going back to the year 2021 and telling the good people of HN that in 2023 AI would be as advanced like it is now. Literally no one would have believed you in 2021 if you did.
[deleted]
Re: GPT-4 gets a B on my quantum computing final exam
#119Earlier quoted context omitted.
>No negativity towards AI here. It’s amazing and it’ll change the future. But we need to be careful on the way. Yeah, I suspect a lot of fields will have a similar trajectory to how AI has impacted radiology. It might catch the tumor in 99.9999% of cases, better than any human doctor. But missing a malignant tumor 0.0001% of the time is unacceptable, because it spikes the hospital's malpractice costs. So every single…
But missing a malignant tumor 0.0001% of the time is unacceptable, because it spikes the hospital's malpractice costs. Meanwhile, in every country that isn't America, tumor detection rates go up, cancer outcomes improve, and the cost of delivery falls. Americans continue to claim their system of funding insurance company profits rather than actual healthcare is best.
US has high cancer survival rates though.
https://worldpopulationreview.com/country-rankings/cancer-su...