Okay, this is probably the right place to say this: You can't play D&D with GPT-3/3.5, but you absolutely can with GPT-4. GPT-4 is a solid DM. GPT-3 couldn't remember what it said 30 minutes ago, and was basically incapable of planning, so unless you want a simple dungeon rougelike-esque adventure, it'll lose track of things and start hallucinating. It will also sometimes forget the rules. My initial impressions are…
> Also, unlike GPT-3, it will roll dice for you I'd question the fairness of those rolls. But yeah, DMing seems like an excellent fit for these models. But you probably need to track hitpoints and stats separately, GPT-4 can't do math either. Or I guess it not doing math might be a feature, that way it will tell you what reasonably happens with fuzzy logic, might be a more immersive experience.
GPT can learn do to that: not providing true randomness, but the illusion of it to serve the game.