Google's "Ask AI" and ChatGPT's free models seem to be consistently bad to the point where I've mostly stopped using them.
I've lost track of how many times it was like "yes, you're right, I've looked at the code you've linked and I see it is using a newer version than what I had access to. I've thoroughly scanned it and here's the final solution that works".
And then the solution fails because it references a flag or option that doesn't even exist. Not even in the old or new version, a complete hallucination.
It also seems like the more context it has, the worse it becomes and it starts blending in previous solutions that you explained didn't work already that are organized slightly different in the code but does the wrong thing.
This happens to me almost every time I use it. I couldn't imagine paying for these results, it would be a huge waste of money and time.