I might be misquoting this, because, like most people, I found the way he builds up this argument more fun and memorable and interesting than the argument itself.
Do not read the book to understand Gödel's theorem, or Escher, or Bach. In fact, Hofstadter is not even really interested in Gödel's theorem itself: his interest is more in the particular trick that Gödel used to prove the theorem (Gödel numbering), which allows Gödel to encode statements about the system as arithmetic statements (within the system). And although the explanation in GEB is surely not the best explanations of Gödel's theorem, it is one of the most enjoyable musings on things "like" Gödel numbering — something you won't find in other places that are more interested in Gödel's theorem itself.
I think if one tries to read the book expecting to learn or understand something, one can get frustrated. But like other Pulitzer-Prize winners for nonfiction (say The Soul of a New Machine), any learning is only incidental; what one can enjoy is the way the book is constructed. It is a work of literature, not mathematics. The dialogues are my favourite parts of the book — sure they may not be realistic, but they take surprising turns, they often have a lot hidden in them (I remember reading one half way through and suddenly suspecting something, then noticing that they formed an acrostic, reading the first letters down the page). Other things I most loved about the book is the way it is self-referential, the way everything fits together, elaborate puns seem to be set up over a course of 300 pages, etc.
All in all, it is a book just simply of Hofstadter having fun.
(I had the same impression of Hofstadter's translation of Pushkin's Eugene Onegin — I've read at least three other translations; Hofstadter's may not be most literal but it's surely enjoyable and with the most outrageous rhymes: who else would rhyme "debts" with "Till his creditors cast their nyets"! You can read online an article he wrote [1] before starting his own translation, then a very critical review of his translation [2] but whose "bad" examples (and the whole first chapter linked there) show what's actually fun.)
You can see him enjoying himself, and you can go along if you'd like to have fun as well, forgiving a few things here and there, skipping parts that you don't find as much fun.
[1]: https://archive.nytimes.com/www.nytimes.com/books/97/07/20/r...
[2]: https://archive.nytimes.com/www.nytimes.com/books/99/09/12/r...