Live data from Hacker News

AI hallucinate. Do you ever double check the output?

news.ycombinator.com

11–20 of 24 posts

Re: AI hallucinate. Do you ever double check the output?

#11
In my opinion, the way this will play out is with a significant amount of validation and human oversight to fully utilize these LLMs. As you mentioned, I recommend giving the AI room for error and improving the experience of manually checking everything. Maybe create a tool to facilitate manually checking the output?

This is a valuable read: https://www.ufried.com/blog/ironies_of_ai_1/

Re: AI hallucinate. Do you ever double check the output?

#12
Yes, of course I review everything.

I treat it like hiring a consultant. They do a lot of work, but I still review the output before making a decision or passing it on.

Sending something with errors to my boss or peers makes me look stupid. Saying it was caused by unrevised AI makes me look stupider.

Re: AI hallucinate. Do you ever double check the output?

#15
FWIW, I utilize Perplexity a lot, and Gemini occasionally for what we old geezer call spitballing.

Part of the reason I like Perplexity is because of the embedded references, and I always, always, double check the sources and holler at the Perp AI when it is clearly confabulating or misinterpreting. Still gives me insights and is useful, but trust-but-verify isn't just about arms control ;)

Re: AI hallucinate. Do you ever double check the output?

#16
post #3

I also don't trust LLMs, but I still find automations useful. Even with human-in-the-loop they save a bunch of time. Clicking "Approve & Send" is much quicker than manually writing out the email, and I just rewrite the 5% that contains hallucinations.

Why not just write the 5% that contains meaningful communication?

Spare the recipients from reading generated filler / slop?

Re: AI hallucinate. Do you ever double check the output?

#18
post #3

I also don't trust LLMs, but I still find automations useful. Even with human-in-the-loop they save a bunch of time. Clicking "Approve & Send" is much quicker than manually writing out the email, and I just rewrite the 5% that contains hallucinations.

Why not just write the 5% that contains meaningful communication? Spare the recipients from reading generated filler / slop?

I meant 5% of the emails, not 5% of the email content. Agree with you that most of the AI generated content is 100% slop; however, you can prompt engineer until it produces meaningful messages.

Re: AI hallucinate. Do you ever double check the output?

#19
post #12

Yes, of course I review everything. I treat it like hiring a consultant. They do a lot of work, but I still review the output before making a decision or passing it on. Sending something with errors to my boss or peers makes me look stupid. Saying it was caused by unrevised AI makes me look stupider.

how did you implement human in the loop?

Re: AI hallucinate. Do you ever double check the output?

#20

Ever? More like always. Keeping humans in the loop is the current best practice. If you truly need to automate something that cannot afford a human checkpoint, find a deterministic solution for it, not LLMs.

what's your workflow for the human review?
Post reply on HN