Earlier quoted context omitted.
The only thing that changed for me was a that it couldn't control my smart Home devices anymore, nor activate navigation, nor send messages via Whatsapp (I.e. while driving). Literally every thing I used it for got answered via "I cannot do that yet" after it randomly opted me into that. Pure garbage.
Then why are you using it? I tried using Gemini once on my Pixel 6. Couldn't play music on Youtube music on verbal instructions, I switched back to Google Assistant. Will try it again after 6 months now. :)
That said, at some point it started working better, but there was a good 6-12 months where it was a tire fire.