Live data from Hacker News

Show HN: What's AI's go-to, public or private healthcare?

modelbias.ai

1–4 of 4 posts

Re: Show HN: What's AI's go-to, public or private healthcare?

#2
In an attempt to uncover biases and default choices AI makes, I asked 100 AI models, 100 simple questions, 3 times each.

I am not sure what this tells, but I found it interesting that most of the models were very much in agreement. With some outliers like Mistral and Llama on some questions.

I even made a benchmark, ConsensusBench, to measure how aligned they were: https://www.modelbias.ai/consensus-bench

Re: Show HN: What's AI's go-to, public or private healthcare?

#3
post #2

In an attempt to uncover biases and default choices AI makes, I asked 100 AI models, 100 simple questions, 3 times each. I am not sure what this tells, but I found it interesting that most of the models were very much in agreement. With some outliers like Mistral and Llama on some questions. I even made a benchmark, ConsensusBench, to measure how aligned they were: https://www.modelbias.ai/consensus-bench

The explore by prompt dropdown doesn’t seem to work.

Re: Show HN: What's AI's go-to, public or private healthcare?

#4
post #3
post #2

In an attempt to uncover biases and default choices AI makes, I asked 100 AI models, 100 simple questions, 3 times each. I am not sure what this tells, but I found it interesting that most of the models were very much in agreement. With some outliers like Mistral and Llama on some questions. I even made a benchmark, ConsensusBench, to measure how aligned they were: https://www.modelbias.ai/consensus-bench

The explore by prompt dropdown doesn’t seem to work.

How strange, works fine here. What OS/browser do you use?