Make sure you don't neglect its contrary twin: Emperor's New Mind. (The entire dialectic between these two books is something straight out of G.E.B.)
I haven't read GEB, but I loved reading the Emperor's New Mind by Roger Penrose. It's a little all over the place, going from non-periodic tiling patterns to quantum mechanics and relativity, all to argue against the case for strong AI.