List animals until failure
rose.systems
List animals until failure
1–10 of 198 posts
Re: List animals until failure
#2It might be an interesting LLM benchmark: how many can they list without breaking the rules (repetition or non-animals). Although I bet that big bucks would be then thrown at pointlessly optimizing for that benchmark, so...
Re: List animals until failure
#3there are so many special cases that this game responds to, i was shocked that it didn’t involve an llm at all at the end. very cool.
Re: List animals until failure
#4For anyone wondering: This is based on basic text parsing and a key-value lookup table, no AI involved whatsoever.
Here's the table: https://rose.systems/animalist/lower_title_to_id.js
Re: List animals until failure
#5For anyone wondering: This is based on basic text parsing and a key-value lookup table, no AI involved whatsoever. Here's the table: https://rose.systems/animalist/lower_title_to_id.js
There must be another table. I got "Are you Australian?" for "dingo" and for "cicada" "don't you love their songs?"
Re: List animals until failure
#6I got 42. I was very impressed by how it handled more and less specific categories. It also understood rotifers were a microscopic animal, which I half expected not to work. Great project.
Re: List animals until failure
#7It might be an interesting LLM benchmark: how many can they list without breaking the rules (repetition or non-animals). Although I bet that big bucks would be then thrown at pointlessly optimizing for that benchmark, so...
Might be an interesting problem for understanding how various models perform recollection of prior tokens within the context window. I'm sure they could list animals until their window is full but what I'm not sure of is how much of the window they could fill without repeating.
Re: List animals until failure
#868. The unique title texts are really fun. But I strongly disagree that "chipmunks are squirrels".
Re: List animals until failure
#9For anyone wondering: This is based on basic text parsing and a key-value lookup table, no AI involved whatsoever. Here's the table: https://rose.systems/animalist/lower_title_to_id.js
There must be another table. I got "Are you Australian?" for "dingo" and for "cicada" "don't you love their songs?" edit: https://rose.systems/animalist/eggs.js
Yea, there's a bunch of easter eggs. And then there's the table for the taxonomy tree.
Re: List animals until failure
#10[deleted]