Earlier quoted context omitted.
1. By definition 2. Because the math works out better If it turns out that things that depend on prime numbers work in all cases except for 1, you might as well define 1 not to be a prime number. http://en.wikipedia.org/wiki/Prime_number#Primality_of_one
"By definition" is a poor justification. I almost referenced the exact link you've given here. It gives poor justification for primality of one - resting on authority and lacking justification. The closest it comes (not very) is, "If 1 were admitted as a prime, these two presentations would be considered different factorizations of 15 into prime numbers, so the statement of that theorem would have to be modified." So…
In the case of prime numbers I believe you cited one of the best reasons of leaving 1 out of the set. If someone needs a name for "the number one and all prime numbers", they can define it.