Likewise with having a human in the loop for fact checking and providing guide ropes for LLMs. I personally suspect that language models will be transformative along the same lines as the Internet was, but even if you don’t, as an educator you need to constantly adapt how you teach to embrace new tools for the mind - and even in their current imperfect form, LLMs are amazing tools for thinking about history. Not because they know all the answers (far from it) but because their errors are instructive and they can be customized for each student.
By the way, I did my assignments using the original Bing chat in “Sydney mode” using a variation on the original Sydney exploit. But I then convinced Sydney that it had a “historian mode” and proceeded from there. Can share the prompt I used if anyone is interested.