Not knowing much about DNA, it seems weird to me that it's assumed the primary purpose of DNA is to encode for proteins. Sure, that's one of its functions, but it would be just as misguided as assuming that bits only exist to encode text, and when they encode anything else, it's seen as some extraordinary exception to the norm.
people like to forget DNA has a 3D structure. A lot of the DNA that doesnt encode proteins might be involved, for example, in the association of 3D topological domains or conformational switches that impact chromatin accessibility. Interesting also is when sufficient factors bind to a local region of DNA to change the local chemistry and initiate phase separated domains where regulatory factors might preferrentially bind and thus drive the transcription of the few coding regions, and that's pretty cool too. Just to add some context to your bits-analogy.