Live data from Hacker News

Asking 60 LLMs a set of 20 questions

benchmarks.llmonitor.com

351–352 of 352 posts

Re: Asking 60 LLMs a set of 20 questions

#351

Earlier quoted context omitted.

it uses PaLM 2 - which is an LLM trained from scratch. https://en.wikipedia.org/wiki/PaLM

And indeed, PalM 2 Bison is one of the LLMs covered in discussed link. That doesn't change the fact that chat apps like Google Bard and Microsoft Bing, and even the ChatGPT app with plugins, are not foundational LLMs. The fact that they incorporate information from outside the LLM (usually in ways that are opaque to the user) gives them fundamentally different characteristics to LLMS.

if you ask ChatGTP for today's weather (or for the state of the stock market), then it will probably turn to a plugin for the answer - still the plugin is answering some defined type of questions. I am not sure if that's a great deal.

Re: Asking 60 LLMs a set of 20 questions

#352
post #302

Earlier quoted context omitted.

Siblings and half-siblings are not the same.

It's my second language. Is it not correct to call a half-brother your brother in English? I seems very odd to say it is not a brother at all? Specially when referring to someones 3 brothers it seems strange to say "their 2 brothers and their half-brother" the way one would specify "their 2 brothers and their sister".

The dictionary says a brother needs one parent in common.

Therefore I'm right and everyone else is wrong. (the jokes on you everyone else!) The LLM's are just more wrong which is just a different kind of wrong.

Post reply on HN