Stop Evaluating LLMs on Vibes
github.com
Stop Evaluating LLMs on Vibes
1–8 of 8 posts
Re: Stop Evaluating LLMs on Vibes
#2Stop deploying LLMs to your users based on vibes. Use TruLens to evaluate your LLM apps
Re: Stop Evaluating LLMs on Vibes
#3Learn more about TruLens here if you're curious: https://medium.com/trulens/evaluate-and-track-your-llm-exper...
Docs and other resources at: https://www.trulens.org/
Re: Stop Evaluating LLMs on Vibes
#4Any acceleration in the evaluation process is welcome and much, much needed. Looking forward to checking out TruLens.
Re: Stop Evaluating LLMs on Vibes
#5Developer on the trulens team here. We just put out a pretty cool new release (0.1.2). Integration with huggingface pipelines in langchain and asynchronous feedback management are just some of the useful updates in this release.
Real evaluations (maybe evaluated by LLMs themselves) instead of just vibe checks is the next big step we need to take as an industry.
Re: Stop Evaluating LLMs on Vibes
#6It's essential to assess language models based on their performance and capabilities rather than subjective measures like "vibes."
Re: Stop Evaluating LLMs on Vibes
#7Any acceleration in the evaluation process is welcome and much, much needed. Looking forward to checking out TruLens.
Thanks! Would love to get any feedback.
Re: Stop Evaluating LLMs on Vibes
#8You guys are on fire