As a graudate student who just working as management & IR, I use LLM to do daily jobs , including weekly briefing and
But AI generated report looks too good to be checked, and hallucination can't be terminated. But Boss and SEC can not tolerate any number mistakes.
So, can you tell me, how do you solve this problem?
Ask HN: How do you make LLM generated text believable?
1–10 of 11 posts
Re: Ask HN: How do you make LLM generated text believable?
#2...do you actually send the SEC LLM-generated documents?
Do you understand the liability you're assuming, doing that?
Re: Ask HN: How do you make LLM generated text believable?
#3> So, can you tell me, how do you solve this problem?
Write it yourself.
Re: Ask HN: How do you make LLM generated text believable?
#4If you were writing it yourself you would proofread and double-check everything. Why do you think that’s no longer required?
Re: Ask HN: How do you make LLM generated text believable?
#5[dead]
Re: Ask HN: How do you make LLM generated text believable?
#6> But AI generated report looks too good to be checked
have you considered...checking it anyway, no matter how good it looks?
Re: Ask HN: How do you make LLM generated text believable?
#7I am sorry that I did not explain my question explicitly. I write recurring weekly briefings for internal use, such as market insights and industry news.
I’m not trying to make AI-generated text “believable”. I’m asking almost the opposite question: when an AI generated text is fluent enough to hide mistakes, how do human check how to systematically check numbers, dates, cites and judgements?
Re: Ask HN: How do you make LLM generated text believable?
#8...do you actually send the SEC LLM-generated documents? Do you understand the liability you're assuming, doing that?
Oh no I am not a attorney, but I need to analyze the market, 20-F and 10-K recurringly and make strategy suggestions, and so yes I use LLM to do business brief.
Re: Ask HN: How do you make LLM generated text believable?
#9I am sorry that I did not explain my question explicitly. I write recurring weekly briefings for internal use, such as market insights and industry news. I’m not trying to make AI-generated text “believable”. I’m asking almost the opposite question: when an AI generated text is fluent enough to hide mistakes, how do human check how to systematically check numbers, dates, cites and judgements?
Have it output the numbers it's basing the conclusion on, have it output a program that it's used to do math to derive judgements.
Re: Ask HN: How do you make LLM generated text believable?
#10I am sorry that I did not explain my question explicitly. I write recurring weekly briefings for internal use, such as market insights and industry news. I’m not trying to make AI-generated text “believable”. I’m asking almost the opposite question: when an AI generated text is fluent enough to hide mistakes, how do human check how to systematically check numbers, dates, cites and judgements?
Have it output the numbers it's basing the conclusion on, have it output a program that it's used to do math to derive judgements.
Yes, i agree that quantitative part， like dates, numbers, amounts should be extracted and let the LLM to output original numbers and computation steps. That's not hard for a briefing harness.
However, my most confusion part is qualitative side, like market insight from a news,policy change and interpretation, and industry NEWS interpretation, they are not straight math but they need tracebility. Do you have any idea to solve those judgement claim?