To me, someone without a full understanding of the AI systems, it seems like the problem is most strongly influenced by image classification. The next logical step in this research is to remove image classification from the loop, since it's a confounding factor.
He asked AI to count carbs 27000 times. It couldn't give the same answer twice
31–40 of 329 posts
Re: He asked AI to count carbs 27000 times. It couldn't give the same answer twice
#32What a dumb article. The picture of the sandwich is essentially just a picture of bread. You can’t see what’s inside. A human wouldn’t be able to tell you. These are essentially AI hit pieces.
Re: He asked AI to count carbs 27000 times. It couldn't give the same answer twice
#33I am... unsure why anyone would think LLMs would be able to do this. They are not magic oracles. Like I think even most humans would be extremely bad at this. Like, are people actually using LLMs for this? Please do not, it won't work.
I mean people will shamelessly paste you a wall of text from LLM while chatting with you to prove a point, probably thinking how they outsmarted you now...
Re: He asked AI to count carbs 27000 times. It couldn't give the same answer twice
#34It’s just an impossible problem. Photons don’t provide sufficient information to determine calories (at least not in any way they could practically be captured). Inside that sandwich could be drenched with olive oil or it could be hollow cheese with lettuce. It’s impossible to tell.
The average person has no idea this is true. And the average person cannot tell when this is the case. So we have a bunch of people, going their way through school, and then when they get stuck relying on AI. The future is gonna be wild.
Yep. And it doesn't help that the people selling AI products act as if they're going to build God. Going, "well AI can't do that" isn't going to fly when you are lax about communicating its limitations!
Re: He asked AI to count carbs 27000 times. It couldn't give the same answer twice
#35[dead]
Re: He asked AI to count carbs 27000 times. It couldn't give the same answer twice
#36It’s just an impossible problem. Photons don’t provide sufficient information to determine calories (at least not in any way they could practically be captured). Inside that sandwich could be drenched with olive oil or it could be hollow cheese with lettuce. It’s impossible to tell.
Then it should refuse to answer 100% of time.
Re: He asked AI to count carbs 27000 times. It couldn't give the same answer twice
#37I am... unsure why anyone would think LLMs would be able to do this. They are not magic oracles. Like I think even most humans would be extremely bad at this. Like, are people actually using LLMs for this? Please do not, it won't work.
It’s worse, I bet there are apps in the App Store that do this, the users just have no idea on the accuracy
There is a very popular app for macro counting called Cal AI that was reported to have been written by a high school student with over $1M in revenue. Looks like it was just acquired by MyFitnessPal
Re: He asked AI to count carbs 27000 times. It couldn't give the same answer twice
#38i've found that multiple queries with the same prompt that requests a short answer is an excellent way to gain a confidence style measure that actually works.
Re: He asked AI to count carbs 27000 times. It couldn't give the same answer twice
#39It’s just an impossible problem. Photons don’t provide sufficient information to determine calories (at least not in any way they could practically be captured). Inside that sandwich could be drenched with olive oil or it could be hollow cheese with lettuce. It’s impossible to tell.
The average person has no idea this is true. And the average person cannot tell when this is the case. So we have a bunch of people, going their way through school, and then when they get stuck relying on AI. The future is gonna be wild.
I am asking a lot here, but school needs to be training people what AI is and what it's weaknesses are and how to use it... My school taught me to use a calculator. It also taught me how to check my work when I relied on the calculator.
AI is a very complicated calculator - you give it an input, magic happens, it gives you an output. Really no different, to a layman.
Re: He asked AI to count carbs 27000 times. It couldn't give the same answer twice
#40I am... unsure why anyone would think LLMs would be able to do this. They are not magic oracles. Like I think even most humans would be extremely bad at this. Like, are people actually using LLMs for this? Please do not, it won't work.
It’s because AI can debug a programme and people start thinking it can do fitness and health stuff too, but the thing is, there is no “instant-reacting compiler" for health or fitness. Things change over a long time, till then AI would have run out of context or lost the data from its cache, or the user may have got bored and deleted their account.