Viewing profile — dabs

Seriously, this is a statement you can make in promptfoo configuration: ``` assert: - type: equals value: 'Hello, World!' ``` We are redefining the equality operator in YAML. Someo…

I have seen frameworks in other spaces attempt the configuration driven approach and have seen it always fall out of favor vs. programmatic approaches. I am reading the docs right …

Please do surfing next and add it to Surfline

thanks for the list, super handy!

Testing AI systems is challenging. We ran into this question collaborating on an AI system that revises sales contracts. Some of the questions we had to answer were: - What makes t…

Testing AI systems is challenging. We ran into this question collaborating on an AI system that revises sales contracts. Some of the questions we had to answer were: - What makes t…

In chatting with many full-stack engineers, both at start ups and larger companies, I've noticed many are just dipping their toes into testing the AI components of their apps. Many…

Hey all, my friend and I were building a web app that involves calling an LLM and ran into the question of testing. Although there are many great solutions out there, we couldn't f…

Good question! ChatGPT certainly makes it easier to implement a prototype that works quite well for documents meeting certain conditions. For example, it does pretty well with rest…

Hi all! My friend and I (MIT alumni and longtime engineers) created Papermint (papermintai.com), a web application that allows you to easily extract multiple key phrases from any P…

Question for someone with a more theoretical background: The paper shows that the EMX learnability of some class of functions with respect to some set of probability distributions …