This is a valuable read: https://www.ufried.com/blog/ironies_of_ai_1/
AI hallucinate. Do you ever double check the output?
11–20 of 24 posts
Re: AI hallucinate. Do you ever double check the output?
#12I treat it like hiring a consultant. They do a lot of work, but I still review the output before making a decision or passing it on.
Sending something with errors to my boss or peers makes me look stupid. Saying it was caused by unrevised AI makes me look stupider.
Re: AI hallucinate. Do you ever double check the output?
#13Not at all
Re: AI hallucinate. Do you ever double check the output?
#14Re: AI hallucinate. Do you ever double check the output?
#15Part of the reason I like Perplexity is because of the embedded references, and I always, always, double check the sources and holler at the Perp AI when it is clearly confabulating or misinterpreting. Still gives me insights and is useful, but trust-but-verify isn't just about arms control ;)
Re: AI hallucinate. Do you ever double check the output?
#16I also don't trust LLMs, but I still find automations useful. Even with human-in-the-loop they save a bunch of time. Clicking "Approve & Send" is much quicker than manually writing out the email, and I just rewrite the 5% that contains hallucinations.
Spare the recipients from reading generated filler / slop?
Re: AI hallucinate. Do you ever double check the output?
#17Re: AI hallucinate. Do you ever double check the output?
#18I also don't trust LLMs, but I still find automations useful. Even with human-in-the-loop they save a bunch of time. Clicking "Approve & Send" is much quicker than manually writing out the email, and I just rewrite the 5% that contains hallucinations.
Why not just write the 5% that contains meaningful communication? Spare the recipients from reading generated filler / slop?
Re: AI hallucinate. Do you ever double check the output?
#19Yes, of course I review everything. I treat it like hiring a consultant. They do a lot of work, but I still review the output before making a decision or passing it on. Sending something with errors to my boss or peers makes me look stupid. Saying it was caused by unrevised AI makes me look stupider.
Re: AI hallucinate. Do you ever double check the output?
#20Ever? More like always. Keeping humans in the loop is the current best practice. If you truly need to automate something that cannot afford a human checkpoint, find a deterministic solution for it, not LLMs.