I am a physics professor and often use Gemini to check my papers. It is a formidable tool: it was able to find a clerical error (a missing imaginary unit in a complex mathematical expression) I was not able to find for days, and it often underlines connections between concepts and ideas that I overlooked. However, it often makes conceptual errors that I can spot only because I have good knowledge of the topic I am di…
I agree and put it this way: LLMs sound so convincing presenting you the work it does rose colored and promising to give you more if you keep going. There is a 50/50 chance that it turns out to be right or letting you jump of the cliff. Only the trip stays the same beautiful 5 star plus travel. Also, spotting an error and telling LLM makes it in most cases worse, because the LLM wants to please you and goes on to apo…
In one case, it made a thoroughly convincing argument that an approach was justified. The second time it made exactly the opposite argument, which was equally compelling.
I now see LLMs as persuasion machines.