Hello, Is it possible to use Traceloop's LLM instrumentations with already existing opentelemetry implementation ?
Yes, ofc. The LLM instrumentations are just like all other instrumentations.
Show HN: OpenLLMetry – OpenTelemetry-based observability for LLMs
31–35 of 35 posts
Re: Show HN: OpenLLMetry – OpenTelemetry-based observability for LLMs
#32Earlier quoted context omitted.
Definitely! (Tomer from Traceloop here) We've already started developing the typescript SDK. Would love to see exactly what your use case is, so we can prioritize specific instrumentation and collaborate on it. We'll ping you.
Nice! Does traceloop support OpenTelemetry Protocol File Exporter? I'm the maintainer of Insomnium ( https://github.com/ArchGPT/insomnium ) and I'm building a LanceDB-based prompt orchestration framework for automated software development that I'm integrating into Insomnium these few weeks. (The orchestration framework will also be open-source soon) Traceloop cloud looks good but I think for simple cases my users wil…
Yes, since we're using vanilla OpenTelemetry, you can set your exporter to whatever you want, including OpenTelemetry Protocol File Exporter. But I'd still use some sort of a dashboard, like Jaeger or one of the open source observability platforms like SigNoz or HyperDX that you can run locally.
Re: Show HN: OpenLLMetry – OpenTelemetry-based observability for LLMs
#33Will vLLM be supported as well?
Hey it's Gal from Traceloop,
That's a good tbh. I wonder whether we should implement instrumentations for LLMs "hosting solutions" or for specific LLMs (E.g. LLaMa/Falcon) and ignore the hosting solution (not sure if that's even possible though as it sort of dictates the inference api).
wdyt?
Re: Show HN: OpenLLMetry – OpenTelemetry-based observability for LLMs
#34Hello, Is it possible to use Traceloop's LLM instrumentations with already existing opentelemetry implementation ?
Yes, ofc. The LLM instrumentations are just like all other instrumentations.
Thank you,
Does it work on Azure OpenAI calls for langchain ? seems it did not work for me or im missing somethin
Re: Show HN: OpenLLMetry – OpenTelemetry-based observability for LLMs
#35Earlier quoted context omitted.
Yes, ofc. The LLM instrumentations are just like all other instrumentations.
Thank you, Does it work on Azure OpenAI calls for langchain ? seems it did not work for me or im missing somethin
It should work, but LangChain has many quirks so it can depend on which syntax you're using. Ping us on slack and we'll assist -
https://join.slack.com/t/traceloopcommunity/shared_invite/zt...