great product, so easy to use. love it.
Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows to Improve LLM Apps
21–30 of 64 posts
Re: Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows to Improve LLM Apps
#22This is actually one of the more interesting LLM observability platforms I've seen. Beyond addressing scaling issues, where do you see yourself going next?
What are other potential platforms?
Bunch of them : Langsmith, Lunary, Phoenix Arize, Portkey, Datadog and Helicone.
We also picked Langfuse - more details here: https://www.nonbios.ai/post/the-nonbios-llm-observability-pi...
Re: Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows to Improve LLM Apps
#23great product & great team, kudos & congrats! :)
Re: Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows to Improve LLM Apps
#24Seems like Langfuse is becoming the standard. Whenever I talk to other builders, they're using Langfuse.
Thank you! If these builders have some feedback to share, ask them to reach out to us :)
Re: Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows to Improve LLM Apps
#25Looks awesome! Been using for over a year now and it's a great product :) The new improvements seems exciting.
Re: Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows to Improve LLM Apps
#26Earlier quoted context omitted.
What are other potential platforms?
Bunch of them : Langsmith, Lunary, Phoenix Arize, Portkey, Datadog and Helicone. We also picked Langfuse - more details here: https://www.nonbios.ai/post/the-nonbios-llm-observability-pi...
Thanks, this post was insightful. I laughed at the reason why you rejected Arize Phoenix, I had similar thoughts while going through their site!=)
> "Another notable feature of Langfuse is the use of a model as a judge ... this is not enabled in the free version/self-hosted version"
I think you can add LLM-as-judge to the self-hosted version of Langfuse by defining your own evaluation pipeline: https://langfuse.com/docs/scores/external-evaluation-pipelin...
Re: Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows to Improve LLM Apps
#27[flagged]
Re: Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows to Improve LLM Apps
#28Congratulations @Marc. Been using this product for 5ish months, love the iteration and how the team reacts to feedback. The prompt versioning has been immensely valuable!
Re: Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows to Improve LLM Apps
#29(unsolicited review) we've been happy adopters of LangFuse at AINews (https://smol.ai/news). ive been tracking the llm ops landscape (https://www.latent.space/p/braintrust) for a while and its very nice to have an open source solution that is so comprehensive and intuitive!
reflections/thoughts on where this field goes next:
1. i wonder if there are new ops solutions for the realtime apis popping up
2. retries for instructor like structured outputs mess up the traces, i wonder if they can be tracked and collapsible
3. chatgpt canvas like "drafting" workflows are on the rise (https://www.latent.space/p/inference-fast-and-slow) and again its noisy to see in a chat flow
4. how often do people actually use the feedback tagging and then subsequently finetuning? i always feel guilty that i dont do it yet and wonder when and where i should.
Re: Launch HN: Langfuse (YC W23) – OSS Tracing and Workflows to Improve LLM Apps
#30Congratulations @Marc. Been using this product for 5ish months, love the iteration and how the team reacts to feedback. The prompt versioning has been immensely valuable!
Thanks AJ, feedback on GitHub/Discord (like yours) has been very helpful to evolve prompt management from a quick addition of the core platform to one of the most-used features -- for which we then actually needed to change a lot of infrastructure to make it reliable and fast (see blog post linked in the original post)