I felt the same about school: mostly, I hated it, and it was torture to go. I did very well, mostly because my mother instilled a kind of fear of getting less than an A on anything, which my extreme personality ratcheted up to a fear of getting less than A+. I obsessed over test scores, and remembering information came pretty easy.
The only part of school I enjoyed was math. I absolutely loved learning and doing math. That I could do a problem with lots of complicated steps, many of which seemed almost creative, and arrive at a common answer, was like logical magic. And it complimented my budding programming hobby very well.
I started trying to program games almost as soon as I had a computer, when I was still very young. I remember it took a long time to understand for loops at first. Then it took a long time to figure out how to poll keyboard input the right way. Then it took a while to learn the ins and outs of BLTing, and so on.
I left college after only one semester. I still thought the programming thing would probably only be a hobby. Still, I made a game, and tried to sell it. But it only sold 500 copies, so I was discouraged. My adulthood got off to a very rocky start, not knowing what to do. I took me 2 years to realize that I could actually get a programming job with what I already knew. At first, I wouldn't have believed it was possible, not without college. But through a couple of lucky breaks, it happened, and I found myself a full-fledged software developer at a real software company at 21, with no formal education. 15 years later, I find myself in the middle of a pretty interesting, varied programming career.
Looking back, the only parts of school that served me were math, and english. I could have just studied those two during high school, I think, and come out just as well. Everything else was self study.