This site is impossible to read on my phone. Part of the left side of the screen is cut off and I can’t scroll it into view
Switching to desktop mode fixed it for me
Show HN: Ask-human-mcp – zero-config human-in-loop hatch to stop hallucinations
21–30 of 65 posts
Re: Show HN: Ask-human-mcp – zero-config human-in-loop hatch to stop hallucinations
#22> an mcp server that lets the agent raise its hand instead of hallucinating
a) It doesn't know when it's hallucinating.
b) It can't provide you with any accurate confidence score for any answer.
c) Your library is still useful but any claim that you can make solutions more robust is a lie. Probably good enough to get into YC / raise VC though.
Re: Show HN: Ask-human-mcp – zero-config human-in-loop hatch to stop hallucinations
#23If you are answering these questions yourself, why not just add something like this to your cursor rules? "If you don't know the answer to a question and need the answer to continue, ask me before continuing" Will you have some other person answer the question?
I’ve tried putting “stop and ask for help” in prompts/rules and it seems like Cursor + Claude, up to 3.7, is highly aligned against asking for help.
[deleted]
Re: Show HN: Ask-human-mcp – zero-config human-in-loop hatch to stop hallucinations
#24Earlier quoted context omitted.
The same way it knows anything else. So not at all, but that doesn't mean it's not useful.
I'll try to give you credit for more than dismissing my question off-hand... Yes, it may not need to know with perfect certainty when it's unsure or stuck, but even to meet a lower bar of usefulness, it'll need at least an approximate means of determining that its knowledge is inadequate. To purport to help with the hallucination problem requires no less. To make the issue a bit more clear, here are some candidate co…
You are trying to control a system that is inherently chaotic.
You can probably get some where by indeed running a task 1000 times and looking for outliers in the execution time or token count. But that is of minimal use and anything more advanced than that is akin to water divining.
Re: Show HN: Ask-human-mcp – zero-config human-in-loop hatch to stop hallucinations
#25This site is impossible to read on my phone. Part of the left side of the screen is cut off and I can’t scroll it into view
Rotate phone to landscape
Re: Show HN: Ask-human-mcp – zero-config human-in-loop hatch to stop hallucinations
#26Cool conceptually, but how exactly does the agent know when it's unsure or stuck?
the reasoning aspect of most llms these days knows when its unsure or stuck, you can get that from its thinking tokens. It will see this mcp and call it when its in that state. Though this could benefit from some rules file to use it, although cursor doesn't quite follow ask for help rules, hence making this.
Re: Show HN: Ask-human-mcp – zero-config human-in-loop hatch to stop hallucinations
#27Earlier quoted context omitted.
Having another person answer the question is pretty much the obvious route this will go.
But then that means they are editing a markdown file on your computer? How is that meant to work? I like the idea but would rather it use Slack or something if it's meant to ask anyone.
this is mainly meant as a way to conversate with the model while you are programming with it. This is not meant to pull questions to a team but more to pair program. a markdown file is best for syntax in an llm prompt and also just easiest to have open and answer questions with. If i had more time and could i would build an extension into cursor.
Re: Show HN: Ask-human-mcp – zero-config human-in-loop hatch to stop hallucinations
#28> an mcp server that lets the agent raise its hand instead of hallucinating a) It doesn't know when it's hallucinating. b) It can't provide you with any accurate confidence score for any answer. c) Your library is still useful but any claim that you can make solutions more robust is a lie. Probably good enough to get into YC / raise VC though.
reasoning models know when they are close to hallucinating because they are lacking context or understanding and know that they could solve this with a question.
this is a streamlined implementation of a interanlly scrapped together tool that i decided to open-source for people to either us or build off of.
Re: Show HN: Ask-human-mcp – zero-config human-in-loop hatch to stop hallucinations
#29Cool conceptually, but how exactly does the agent know when it's unsure or stuck?
the reasoning aspect of most llms these days knows when its unsure or stuck, you can get that from its thinking tokens. It will see this mcp and call it when its in that state. Though this could benefit from some rules file to use it, although cursor doesn't quite follow ask for help rules, hence making this.
Does all thinking end up getting replaced by calls to Ask-human-mcp then? Or only thinking that exceeds some limit (and how do you express that limit)?
Re: Show HN: Ask-human-mcp – zero-config human-in-loop hatch to stop hallucinations
#30If you are answering these questions yourself, why not just add something like this to your cursor rules? "If you don't know the answer to a question and need the answer to continue, ask me before continuing" Will you have some other person answer the question?
>If you are answering these questions yourself, why not just add something like this to your cursor rules? What you are asking for is AGI. We still need human in the loop for now.
What I'm describing is a human in the loop. It's just a different UX, one that is easier to use and closer to what the model is trained to use.