This is like saying, "I've developed a new compass for a deep space probe to help it find North!" Our society is actively declaring that falsehoods are truth, and should be celebrated. We're hallucinating ourselves. All this software does is make sure LLMs hallucinate with us.
Such as?
SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues
11–20 of 85 posts
Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues
#12Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues
#13This is like saying, "I've developed a new compass for a deep space probe to help it find North!" Our society is actively declaring that falsehoods are truth, and should be celebrated. We're hallucinating ourselves. All this software does is make sure LLMs hallucinate with us.
Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues
#14How does this work? Does anyone know? And for a large swats of things, how can it possibly work? It’s not possible to say if or if not it is hallucinating code for almost all code and apis, for instance. And I see similar issues with many fields outside pure facts. With privacy issues as well.
It would appear that this is not automated monitoring but more like a second stage of human reinforcement learning or perhaps a classifier. It seems that you create input/output examples and the LLM responses are examined by a secondary system (which I’m guessing is probably NOT an LLM, otherwise it would be vulnerable to attacks) and perhaps force regenerates the LLM response if it doesn’t meet the classification threshold.
At least, that sounds more believable to me than someone claiming they’ve fixed the inherent flaws in LLMs.
Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues
#15This is like saying, "I've developed a new compass for a deep space probe to help it find North!" Our society is actively declaring that falsehoods are truth, and should be celebrated. We're hallucinating ourselves. All this software does is make sure LLMs hallucinate with us.
Such as?
Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues
#16Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues
#17Earlier quoted context omitted.
It's impossible to answer this without getting political. Instead, let's just say every previous generation has been critically wrong about some things. Statistically, we're unlikely to be the outlier.
dang's put me on notice, so I'm walking on eggshells here. But truth isn't political. As long as we think it is, we will continue to follow the descent into madness. Truth is just that: truth. The only reason we think truth is political, is because our chosen leaders so heavily depend on lies that the truth would destroy their reign.
Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues
#18Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues
#19This is like saying, "I've developed a new compass for a deep space probe to help it find North!" Our society is actively declaring that falsehoods are truth, and should be celebrated. We're hallucinating ourselves. All this software does is make sure LLMs hallucinate with us.
Such as?
Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues
#20Earlier quoted context omitted.
Such as?
It's impossible to answer this without getting political. Instead, let's just say every previous generation has been critically wrong about some things. Statistically, we're unlikely to be the outlier.