Viewing profile — Ephil012

To add on to this: I think it should be mentioned that Slack says they'll prevent data leakage across workspaces in their model, but don't explain how they do this. They don't seem…

I recently attended a talk by someone at Balsa Research last week about the Jones Act. Balsa Research is trying to get it repealed. Highly recommend checking them out. https://www.…

Hi all, I had been working with tools like LlamaIndex at work and realized that there were not many good options for monitoring RAG systems for performance. So I built a pretty sim…

Your best bet is probably to go through a doctor and get testing from a medical genome sequencing service that is covered under HIPAA. I am not 100% sure if this is bulletproof, bu…

Dbrand Sues Casetify

AP didn’t provide a link to the official campaign page I think. Here’s the link https://www.restauracionecologica.org/adopciones

Out of curiosity, why do you say the bit about not using CloudFlare's DNS? Is using it incompatible with archive.is?

At my company, we developed an open source library to measure if the context the model received is accurate or not. While not exactly the same as what you're asking, you could in t…

I tried out the Assistants API and noticed that similarly bad performance, but with a catch. Apparently if you combine all the files into one single text file, then the performance…

Here's the catch. I did an analysis earlier myself of the assistants API and discovered this good performance is ONLY for if you combine into a single text file. If you try multipl…

Unfortunately, right now the LLM cost is just a fundamental issue. I think it is hard to get around because comparing answer quality usually involves understanding the question and…

Hey HN, Joe and Ethan from Tonic.ai here again. Alongside last week’s announcement of Tonic Validate Metrics ( https://news.ycombinator.com/item?id=38012126 ), we’ve also released …

Pretty cool tutorial. As a side note, it is pretty hard to evaluate these pipelines for quality once you build them since there's not many standard practices yet given how new this…

Right now, we are planning on adding more metrics in the future. We also have considered adding the ability of using vector embeddings instead of LLMs for analyzing the responses (…

No problem! If you have any questions in the future, feel free to open a issue on Github. Also, we got a free UI for visualizing the metric logs (no paid tier or anything like that…

Hi all, if anyone has any questions about the open source library, Joe and I will be around today to answer them.

Hey HN, Joe and Ethan from Tonic.ai here. We just released a new open-source python package for evaluating the performance of Retrieval Augmented Generation (RAG) systems. Earlier …