Impressed by the model so far. As far as independent testing goes, it is topping our leaderboard for chess puzzle solving by a wide margin now: https://github.com/kagisearch/llm-chess-puzzles?tab=readme-o...
I tried playing against the model, it didn't do well in terms of blocking my win.
However it feels like it might be possible to make it try to think ahead in terms of making sure that all the threats are blocked by prompting well.
Maybe that could lead to somewhere, where it will explain its reasoning first?
This prompt worked for me to get it to block after I put 3 in the 4th column. It otherwise didn't
Let's play connect 4. Before your move, explain your strategy concisely. Explain what you must do to make sure that I don't win in the next step, as well as explain what your best strategy would be. Then finally output the column you wish to drop. There are 7 columns.
Always respond with JSON of the following format:
type Response ={
am_i_forced_to_block: boolean;
other_considerations: string[];
explanation_for_the_move: string;
column_number: number;
}I start with 4.
Edit:
So it went
Me: 4
It: 3
Me: 4
It: 3
Me: 4
It: 4 - Successful block
Me: 5
It: 3
Me: 6 - Intentionally, to see if it will win by putting another 3.
It: 2 -- So here it failed, I will try to tweak the prompt to add more instructions.
me: 4