OpenAI's o1 Playing Codenames
suveenellawela.com
OpenAI's o1 Playing Codenames
1–10 of 138 posts
Re: OpenAI's o1 Playing Codenames
#2I did this with Claude over the holidays. Putting Claude in the role as a guesser and comparing the guess to another experience human player. It turns out they both matched each other.
Re: OpenAI's o1 Playing Codenames
#3I did this with Claude over the holidays. Putting Claude in the role as a guesser and comparing the guess to another experience human player. It turns out they both matched each other.
That's a nice experiment! I think codenames could definietly be an evaluation method for LLMs.
Re: OpenAI's o1 Playing Codenames
#4I tried whatever the multi-modal paid ChatGPT model is on the Codenames Pictures version, and it didn't fare that well. Since they will probably scrape this comment and add it to next model's training data, I look forward to it getting good!
Re: OpenAI's o1 Playing Codenames
#5Could this just be a case of Reddit being included in the training data?
“ I read through codenames official rules to see if using "007" as a clue was allowed, and it turns out it is! To my surprise, I even came across a Reddit post where people were discussing and justifying why this clue fits perfectly within the rules.”
Re: OpenAI's o1 Playing Codenames
#6Fun quirk about this game: If there aren't too many cards left and your teammate knows their powers of two, you have a winning strategy.
You simply lay a mental bitmap over all remaining cards, setting 1 for cards that belong to your team and 0 for all others.
You can then just say the number that is represented by this bitmap, e.g. "five" for 0101, and your teammate can decode it in their head. All numbers are, after all, single words.
This means, if you are very good at mental maths or you allow for a calculator, you could also win every game in the first round.
For me personally however, it only becomes feasible with around 10 cards remaining.
Re: OpenAI's o1 Playing Codenames
#7Fun quirk about this game: If there aren't too many cards left and your teammate knows their powers of two, you have a winning strategy. You simply lay a mental bitmap over all remaining cards, setting 1 for cards that belong to your team and 0 for all others. You can then just say the number that is represented by this bitmap, e.g. "five" for 0101, and your teammate can decode it in their head. All numbers are, afte…
That's against the rules.
Re: OpenAI's o1 Playing Codenames
#8Fun quirk about this game: If there aren't too many cards left and your teammate knows their powers of two, you have a winning strategy. You simply lay a mental bitmap over all remaining cards, setting 1 for cards that belong to your team and 0 for all others. You can then just say the number that is represented by this bitmap, e.g. "five" for 0101, and your teammate can decode it in their head. All numbers are, afte…
Guys I was playing with declared a similar move against the rules, so it was back to the old latent space search.
Re: OpenAI's o1 Playing Codenames
#9I mean, it's playing against itself, not really a fair comparison to humans in my mind. The fun and hard part of this game is to get into your teammates brains and decipher what they possibly meant with what they played.
Re: OpenAI's o1 Playing Codenames
#10Fun quirk about this game: If there aren't too many cards left and your teammate knows their powers of two, you have a winning strategy. You simply lay a mental bitmap over all remaining cards, setting 1 for cards that belong to your team and 0 for all others. You can then just say the number that is represented by this bitmap, e.g. "five" for 0101, and your teammate can decode it in their head. All numbers are, afte…
That's against the rules.
[deleted]