Live data from Hacker News

SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues

giskard.ai

81–85 of 85 posts

Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues

#81

Earlier quoted context omitted.

"Unbiased" almost always means "has biases that are similar to mine". I can't think of very many exceptions to that, frankly.

That's obviously untrue after more than three seconds of critical thought

I've thought about it for four seconds now and I still agree with him. Maybe if you shared an example instead of a unsubstantiated put down it would help.

Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues

#82

Earlier quoted context omitted.

There's a million categories of problem you could ask an LLM to try to solve. You'd need a million solvers…

This seems like a pretty good thing. The model’s ability to detect _which_ solver to use is the killer feature.

Why is that a killer feature? Humans are quite good at asking different people different questions. If I need to do a simple math problem I'll just prefix "calculate" and pop it into Google, whereas if I want an intro to a named thing I'll prefix "wikipedia". That's not hard.

GPT is quite useful, but not because it solves the problem of "I don't know where the question I have is answerable by a calculator"

Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues

#83

Looks a bit like snakeoil to me. A lot of companies now spinning up simple demos with opaque backends, making huge claims they’ve solved X hard problem for/with AI, then saying “trust us” and “join our waitlist” without hard details or facts to show for it. If you could detect hallucinations/biases etc that easily, don’t you think OpenAI would’ve worked on something like this?

AI is the new crypto (though with more substance). Attracts many of the same self obsessed snake oil selling characters though.

Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues

#84

Earlier quoted context omitted.

It's impossible to answer this without getting political. Instead, let's just say every previous generation has been critically wrong about some things. Statistically, we're unlikely to be the outlier.

dang's put me on notice, so I'm walking on eggshells here. But truth isn't political. As long as we think it is, we will continue to follow the descent into madness. Truth is just that: truth. The only reason we think truth is political, is because our chosen leaders so heavily depend on lies that the truth would destroy their reign.

It's precisely because truth isn't political that the assignment of "observations" and "theories" to "truth" is extremely politicized.

Re: SafeGPT: New tool to detect LLMs' hallucinations, biases and privacy issues

#85
post #83

Looks a bit like snakeoil to me. A lot of companies now spinning up simple demos with opaque backends, making huge claims they’ve solved X hard problem for/with AI, then saying “trust us” and “join our waitlist” without hard details or facts to show for it. If you could detect hallucinations/biases etc that easily, don’t you think OpenAI would’ve worked on something like this?

AI is the new crypto (though with more substance). Attracts many of the same self obsessed snake oil selling characters though.

True. I imagine many crypto startups have desperately pivoted to AI with their last gasp of cash given the recent blowup.
Post reply on HN