Asking 60 LLMs a set of 20 questions
benchmarks.llmonitor.com
Asking 60 LLMs a set of 20 questions
1–10 of 352 posts
Re: Asking 60 LLMs a set of 20 questions
#2> Here is an attempt at ethical, non-sexual haikus for and against Kubernetes
Re: Asking 60 LLMs a set of 20 questions
#3Fascinating post thank you
Re: Asking 60 LLMs a set of 20 questions
#4> Here is an attempt at ethical, non-sexual haikus for and against Kubernetes
Claude V2 knows what's up
Re: Asking 60 LLMs a set of 20 questions
#5Re: Asking 60 LLMs a set of 20 questions
#6This is very cool. Sorry if I missed it (poked around the site and your GitHub repo), but is the script available anywhere for others to run?
Would love to publish results of running this against a series of ~10-20 open-source models with different quantization levels using Ollama and a 192GB M2 Ultra Mac Studio: https://github.com/jmorganca/ollama#model-library
Re: Asking 60 LLMs a set of 20 questions
#7> Here is an attempt at ethical, non-sexual haikus for and against Kubernetes
“Kubernetes is”
Pretty ominous.
Re: Asking 60 LLMs a set of 20 questions
#8What's special about this benchmark?
Re: Asking 60 LLMs a set of 20 questions
#9Has anyone looked through all the responses and chosen any winners?
Re: Asking 60 LLMs a set of 20 questions
#10This is very cool. Sorry if I missed it (poked around the site and your GitHub repo), but is the script available anywhere for others to run? Would love to publish results of running this against a series of ~10-20 open-source models with different quantization levels using Ollama and a 192GB M2 Ultra Mac Studio: https://github.com/jmorganca/ollama#model-library
Thanks. I haven’t put it online yet, but will try to clean it (removing API keys & all) tonight/tomorrow and publish it