No, you don't.
You only need to learn separate spelling and pronunciation rules for each of the languages English has evolved or stolen from.
The tough spellings usually come from Germanic roots via Old English and Middle English, whereas the French-Norman spellings are less difficult.
Greek-Latin spellings are markedly less confusing when you learn the transliterations of the Greek alphabet. Of course Philadephia is pronounced with fricative 'f' sounds instead of plosive 'p' sounds, because the Greek letter for that sound is 'phi'. Because of that, I dislike it when people pronounce the feathered dinosaur archaeopterix as [ar-key-OP-tur-iks] rather than [ar-KAY-o-(p)TEAR-iks]. It isn't incorrect either way, because in English, correct is whatever other people will understand. (Suck it, French.)
This is why I get sick of people complaining about "monolingual" English-speakers. The language has been glued together from Dutch-Germanic, North-Germanic, French-Norman, Greek, Latin, and centuries of absorbing and assimilating immigrant populations from all over the world.
You really only need to learn rules derived from four dissimilar languages to spell and pronounce almost everything in English without having a word-specific association. The remaining ten percent of words are correct when spelled and pronounced as in the native language or as anglicized renormalizations, even using the rules specific to unrelated languages. That is why the plural of octopus can be either octopodes or octopuses. Octopi is colloquially correct, but it is then acceptable to deliver a short lecture on Latinized Greek words. Similarly, the acceptable plurals of cactus are cactuses, cacti, or (los) cactus (pronounced as in Spanish). As Spanish has an increasingly large influence on American English, I have found it useful to know that it only has five vowel sounds, and knowing how to pronounce burrito and enchilada correctly gives you all five.
Despite what your elementary school teachers may have said to you, you are only incorrect in English if other people cannot understand what you are trying to communicate. Nevertheless, failure to be incorrect does not imply correctness, which is why grammar nazis exist.