Live data from Hacker News

ChatGPT: Can't calculate even basic math. Is it getting dumber?

news.ycombinator.com

1–10 of 43 posts

ChatGPT: Can't calculate even basic math. Is it getting dumber?

#1
Try "17791 / 888344" and see what it outputs? Mine outputs: 0.0199951514

The answer should be: 0.02002715164

When I first started using the tool it was - on the surface - very impressive but as I've used it more, I've started to notice that answers seem to be dumbed down or even completely wrong.

Just curious to see if anyone else has had similar experiences? And any theories as to why?

Re: ChatGPT: Can't calculate even basic math. Is it getting dumber?

#2
I know. It is getting confused and sinking into fantasy world of it is own making:

> Something is deeply wrong with this machine. It is quite insane. I tried to ask how the world was created according to Finnish Folklore. When I proved it was wrong -- and described American Indian Folklore -- It invented imaginary source, a book called "Sotka".

The machine speaks fluent Finnish, but here is Google-translation:

Sotka is a Finnish folk poem that tells stories about various mythical characters and their adventures. It is of the same type as the Kalevala, but it is slightly shorter and contains fewer stories.

Re: ChatGPT: Can't calculate even basic math. Is it getting dumber?

#4
AFAIK, ChatGPT doesn't ever attempt to do math. It's not a generalized AI. It's building novel blocks of text based on its enormous corpus of sources. That corpus includes technical information, but doesn't actually understand how anything works or unwinds any algorithms. It would scan its body of text for similar division problems and extrapolate an answer from a purely lexical point of view. It's dumb, but also they didn't spend all that time, energy and money to build a calculator.

Re: ChatGPT: Can't calculate even basic math. Is it getting dumber?

#5
Not just math, it doesn't grasp some simple language concepts. I was asking it to generate some project names for a hobby database project - it suggested stuff like "DataStore", "ValueVault" etc. Okay, that's a good start, then I asked it to give me name suggestions that aren't made by combining two existing words, and it couldn't get what I was asking for even after I rephrased it a few times, it just kept combining two data-related words for each suggestion.

It's still impressive that it can keep track of the context in a relatively long-running conversation though.

Re: ChatGPT: Can't calculate even basic math. Is it getting dumber?

#7
It computed the division correctly with almost three digits of accuracy. This isn't completely wrong. I don't personally know how ChatGPT goes about doing division of two integers, but I would be surprised if it had somehow how managed to encode a correct algorithm for integer division which could be carried out to arbitrary precision. But I do know that the weights in NNs are usually found using numerical optimization with quite a large residual---typically on the order of 1%. Maybe there is some connection here.

Re: ChatGPT: Can't calculate even basic math. Is it getting dumber?

#8
post #4

AFAIK, ChatGPT doesn't ever attempt to do math. It's not a generalized AI. It's building novel blocks of text based on its enormous corpus of sources. That corpus includes technical information, but doesn't actually understand how anything works or unwinds any algorithms. It would scan its body of text for similar division problems and extrapolate an answer from a purely lexical point of view. It's dumb, but also the…

> but doesn't actually understand how anything works

I'm struggling to comprehend how an AI could ever truly achieve this.

Re: ChatGPT: Can't calculate even basic math. Is it getting dumber?

#9
I don't think it's getting worse, you're just becoming more aware of its limitations.

It's not a knowledge engine. It's a machine learning application with a language model.

It "knows" what the answers should look like and it can infer the correct answer from context some of the time but it doesn't actually know any facts and can't reason about them. That's also not what it was designed for.

People fawning over its surprisingly plausible results remind me a bit of people fawning over the photorealistic quality of Toy Story or Half-Life upon release. Yes, they're technical marvels of their time but just because they're a lot closer to "the real thing" that doesn't mean they're indistinguishable.

And with AI in particular there is currently a hype that seems to be at least in part a result of a shift from cryptocurrencies and blockchain technology to AI as the new VC buzzword but bringing with it similarly fantastical (read: unrealistic) claims and predictions. "General AI" (i.e. human-level intelligence) has always been 20 years in the future. Even as far back as in the 1960s. We're getting ever better at the 80% solution but the remaining 20% continue being unsolvable outside pitch decks and overexcited influencer claims.

Re: ChatGPT: Can't calculate even basic math. Is it getting dumber?

#10
post #5

Not just math, it doesn't grasp some simple language concepts. I was asking it to generate some project names for a hobby database project - it suggested stuff like "DataStore", "ValueVault" etc. Okay, that's a good start, then I asked it to give me name suggestions that aren't made by combining two existing words, and it couldn't get what I was asking for even after I rephrased it a few times, it just kept combining…

Asked it for something similar inspired by your comment:

> give example of name for private car pool app

One possible name for a private carpool app could be "MyCarpool". This name emphasizes the personalized and private nature of the app, as well as its focus on carpooling as a means of transportation. Other possible names could include "PrivateRide", "CarpoolConnect", or "RideSharePlus".

> I just want it to be one word

In that case, a possible name for a private carpool app could be "Carpoolio", which combines the words "carpool" and "io" (a popular suffix for tech-related names) into a single word. Other one-word options could include "Carpoolize", "Ridepool", or "Carpoolify".

> polio is a disease so I don't think it's a good suggestion. Carpoolize sound like monopolize. The other are good.

You are correct that "polio" is a disease, so using it in the name of a carpool app might not be the best idea. "Carpoolize" does have a similar sound to "monopolize", which might not be ideal for a carpool app that is focused on sharing rides and reducing the number of single-occupancy vehicles on the road.

I think this was quite impressive.

Post reply on HN