Live data from Hacker News

Ask HN: Why does no one seem to care that AI gives wrong answers?

news.ycombinator.com

71–80 of 119 posts

Re: Ask HN: Why does no one seem to care that AI gives wrong answers?

#72

So far this year the following companies have asked me for money for their new "AI" features: - slack - github - microsoft - google - atlassian - notion - clickup - hubspot So ask yourself: Who benefits from the hype? And who would benefit from a better general understanding of the flaws?

Gitlab as well

Re: Ask HN: Why does no one seem to care that AI gives wrong answers?

#73
In 1942, atom bombs didn't work at all. Does that mean nobody on the Manahattan Project cared? In my mind, when I hear that nobody on earth has achieved something, but a massive bubble of people are feverishly working on it, my conclusion is that a lot of people care a lot. I assume by how your post was phrased, you're using the term AI to mean LLM. You noticed that 100% of LLMs, every last one of them, in research labs and commercial businesses, hallucinate and give wrong answers when prompted for something very different from their training data. Thousands are this way. None at all exist that are the other way. A very peculiar property of an entire technology. But your conclusion wasn't that it's inherent property of LLMs (a statistics machine), or that we need to move beyond LLMs to achieve AGI. It wasn't that LLMs have a lot of powerful uses when kept inside the narrow scope of their training. Your conclusion was that, across the entire earth, without exception, "investors/founders/PMs don’t really care". I'm sorry, I am not following — perhaps if you elaborate more on each logical steps you took to get to that conclusion, we can shed more light on what you're missing.

Re: Ask HN: Why does no one seem to care that AI gives wrong answers?

#74

Earlier quoted context omitted.

With Excel you might want that calculator.

Related: https://learn.microsoft.com/en-us/office/troubleshoot/excel/...

Excel must be such an incredible codebase. The amount of spaghetti + spaghetti to keep legacy spaghetti behaviour must really be a sight to behold.

Re: Ask HN: Why does no one seem to care that AI gives wrong answers?

#75

Probably for the same reason that tech hasn't improved anything in a long time. Tolerable Pizza delivery is ruined. The Internet is a walled wasteland now. Far too much "content" that doesn't need to exist. Everything is an ad. None of our lives have been improved by software.

Amen. I hate technology these days. It feels like the big corps managed to mess it up in the worst ways. Oh, you want to check the weather real quick? Here's an ad first. I'm sick of it. None of it even works properly or does what it's supposed to do half of the time but we're just supposed to eat it all up and pay more and more for it all.

Maybe it’s because I willingly pay for quality content and services that I enjoy like news and YT premium, but I don’t think things are that bad. LLMs mess up but they’re new and still have growing pains. My main IDE is great, Windows sucks but the mythical year of the Linux Desktop feels like it’s kind of here and quite usable, games are (much) worse and more predatory, as are most social media platforms but I just avoid those aspects. Privacy and rights over data isn’t great, but the GDPR is pretty good. Incredible resources like sci-hub have come about.

Idk, I felt like this a few years ago but things feel like they’ve got better. I miss the internet of yore just like everyone else (and particularly miss the decentralisation) but a lot is much better.

Re: Ask HN: Why does no one seem to care that AI gives wrong answers?

#76
post #27

Another question, why does nobody care about the enormous and absurd energy cost to train and run models?

Line go up. The only three words that matter nowadays.

Unless we’re talking about solar’s cost per watt, then line go down. Down down down.

Re: Ask HN: Why does no one seem to care that AI gives wrong answers?

#77
post #73

In 1942, atom bombs didn't work at all. Does that mean nobody on the Manahattan Project cared? In my mind, when I hear that nobody on earth has achieved something, but a massive bubble of people are feverishly working on it, my conclusion is that a lot of people care a lot. I assume by how your post was phrased, you're using the term AI to mean LLM. You noticed that 100% of LLMs, every last one of them, in research l…

> In 1942, atom bombs didn't work at all. Does that mean nobody on the Manahattan Project cared?

In 1942 the a-bomb didn't exist. It wasn't an overhyped, extant bomb that gave wrong responses! Straw man. Straw bomb?

Re: Ask HN: Why does no one seem to care that AI gives wrong answers?

#78
post #18

I haven't found a human that answers every single question correctly, either. You know whom to ask a question based off that person's domain of expertise. Well, AI's domain of expertise is everything (supposedly). What gets difficult is evaluating the response, but let's not pretend that's any easier to do when interacting with a human. Experts give wrong answers all the time. It's generally other experts who point o…

I find this a useful frame of reference: don't assume anyone, anything is correct. Learn to work with what is, not what could be. AI is very helpful to me, as long as I don't have unrealistic expectations.

Re: Ask HN: Why does no one seem to care that AI gives wrong answers?

#80

My graduate research was in this area. My lab group developed swarm robots for various terrestrial and space exploration tasks. I spent a lot of time probing why our swarm robots developed pathological behavioral breakdowns - running away from construction projects, burying each other, etc... The issue was so fundamental to our machine learning methods that we never found a way to reliably address it—by the time I le…

I believe I saw this research featured in a documentary or some other film. Am I remebering incorrrectly.
Post reply on HN