The premise of this idea - that anything describable can be written in a binary firm and is thus countable - seems wrong. It's wrong because we easily invent new concepts and put them into a symbolic form. We could invent a new concept, agree on a new symbol for it and add it to our alphabet. The set of ideas isn't countable and so our alphabet isn't countable. This alphabet can't be translated into some binary form…
Why is the alphabet not countable? If each time you think of a new idea and make a symbol for it, I can also assign it to an integer (because there is always a next integer like there is always a new symbol you can come up with). When you come up with a new concept, it should also be possible to write out a definition of it. If you can write down your definition (in English, math notation, etc.), then it comes from a…
There is a world of ideas and the real world. People live in both worlds. When they discover a new idea, often by accident, they label it with a symbol and use it in the real world. Other people can see the same idea and since they can't fully describe it with words, they agree to use the new symbol.
We describe new concepts with words, but those definitions are underspecified: they refer to things with vague or non existent descriptions, or just common sense. What is "set" for example? The same words often mean different things in different contexts. This extra meaning that's always attached to words is what makes these definitions non countable.