Avogadro's constant is not itself a heavily-used value in chemistry. Its derivation is obvious if you think in a different way:
You need to convert from mass to numbers of molecules, which means you need to divide it by the mass of a molecule. The mass of a molecule is determined by the sum of the weights of each of the atoms, themselves the weights of their constituent nucleons [1]. If you fix the weight of a nucleon to be 1 (that is, we measure in daltons), then computing the weight of a molecule such as glucose (aka C₆H₁₂O₆) in daltons is a trivial formula. All you need is a periodic table that lists atomic weights, which is every copy you find a chemist using. It's worth noting that the resulting molecular weights are going to be independent of whatever measuring system you want to use [2], whether it be grams, ounces, alien flits, what have you.
Now you need to convert the mass of your substance into a count of "stuff-loads" of molecules. The simplest and most idiotic thing to do is to define a "stuff-load" to be the amount of molecules in a unit mass if it weighs 1 dalton--in other words, you make this formula be exactly one. In SI, the unit mass for this equation is grams and the "stuff-load" is the mole. If we were using US ounces as the unit mass, we'd define an ounce-mole and use that instead of SI moles.
Put another way: we define a mole such that the constant in the computation of moles from molecular weight and mass is exactly 1. Avogrado's constant itself is merely the inverse of the mass of a nucleon when expressed in grams.
[1] Okay, there's a lot more that goes on into the computation of mass. In terms of the mathematical error, though, other sources of error (e.g., wrong isotopic ratio) are going to matter before these come up.
[2] Up to the slight adjustment (about ±1%) of what you consider the weight of a nucleon to actually be.