Acknowledging that AI is unreliable, the solution is to layer another AI to hopefully let you know about it. Of course, brilliant, why did I expect anything different from the AI industry.
Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry
31–40 of 76 posts
Re: Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry
#32> Know when your LLM app is hallucinating or malfunctioning
It astonishes me that you are willing to make so many deceptive claims on your website like this.
You have no ability to detect with any certainty hallucinations. No one in the industry does.
Re: Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry
#33> Know when your LLM app is hallucinating or malfunctioning It astonishes me that you are willing to make so many deceptive claims on your website like this. You have no ability to detect with any certainty hallucinations. No one in the industry does.
clearly LLM app has added such logic to their app:
``` if (query.IsHallucinated()) { notifyHumanOfHallucination(); } ```
this one line will get them that unicorn eval
Re: Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry
#34Acknowledging that AI is unreliable, the solution is to layer another AI to hopefully let you know about it. Of course, brilliant, why did I expect anything different from the AI industry.
?? but who is monitoring the AI layer monitoring the AI who produced the original output ??
openai audited by claudeai which is then audited by gemini ai...
then to close the loop, gemini ai is then audited by openai
Re: Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry
#35Acknowledging that AI is unreliable, the solution is to layer another AI to hopefully let you know about it. Of course, brilliant, why did I expect anything different from the AI industry.
?? but who is monitoring the AI layer monitoring the AI who produced the original output ?? openai audited by claudeai which is then audited by gemini ai... then to close the loop, gemini ai is then audited by openai
people are lazy, we're more than happy to not be in the loop
Re: Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry
#36> Know when your LLM app is hallucinating or malfunctioning It astonishes me that you are willing to make so many deceptive claims on your website like this. You have no ability to detect with any certainty hallucinations. No one in the industry does.
I think it depends on the use case and how you define hallucinations. We've seen our metrics perform well (=correlates with human feedback) for use cases like summarization, RAG question-answering pipeline, and entity extraction.
At the end of the day things like "answer relevancy" are pretty dichotomic in a sense that for a human evaluator it will be pretty clear whether an answer is answering a question or not.
I wonder if you can elaborate on why you claim that there's no ability to detect with any certainty hallucinations.
Re: Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry
#37> Know when your LLM app is hallucinating or malfunctioning It astonishes me that you are willing to make so many deceptive claims on your website like this. You have no ability to detect with any certainty hallucinations. No one in the industry does.
clearly LLM app has added such logic to their app: ``` if (query.IsHallucinated()) { notifyHumanOfHallucination(); } ``` this one line will get them that unicorn eval
I think that LLMs are hallucinating by design. I'm not sure we'll ever get to a 0% hallucinations and we should be ok with it (at least for the next coming years?). So getting an alert on hallucination becomes less interesting. What is more interesting perhaps is knowing the rate that this happens. And keeping track on whether this rate increases or decreases with time or with changes to models.
Re: Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry
#38Acknowledging that AI is unreliable, the solution is to layer another AI to hopefully let you know about it. Of course, brilliant, why did I expect anything different from the AI industry.
I'm sorry but this is not what we do. We don't use LLMs to grade your LLM calls.
Re: Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry
#39Earlier quoted context omitted.
clearly LLM app has added such logic to their app: ``` if (query.IsHallucinated()) { notifyHumanOfHallucination(); } ``` this one line will get them that unicorn eval
I think that LLMs are hallucinating by design. I'm not sure we'll ever get to a 0% hallucinations and we should be ok with it (at least for the next coming years?). So getting an alert on hallucination becomes less interesting. What is more interesting perhaps is knowing the rate that this happens. And keeping track on whether this rate increases or decreases with time or with changes to models.
[deleted]
Re: Launch HN: Traceloop (YC W23) – Detecting LLM Hallucinations with OpenTelemetry
#40Earlier quoted context omitted.
Im not sure which ones are Otel compliant. Im only aware of 3 that are Otel compliant: 1. Traceloop Otel 2. Langtrace.ai Otel 3. OpenLIT Otel 4. Portkey 5. Langfuse 6. Arize LLM 7. Phoniex SDK 8. Truera LLM 9. Truelens 10. Context 11. Braintrust 12. Parea 13. Context AI 14. openlayer.com 15. Deepchecks 16. langsmith 17. Confident AI 18. Helicone 19. Langwatch.ai 20. Arthur 21. Aporia 22. scale.com 23. Whylabs 24. gen…
dear god, where is this list from? surely not hand curated?
60. Radiant.AI
61. Weights & Biases (Weave)
62. Quotient AI (some observability there)