Earlier quoted context omitted.
You may attract more qualified people, but the number of unqualified people may increase as well. Put another way, you may get more qualified people in absolute numbers, but the signal-to-noise ratio could go up, too.
One option is to find a qualified technical individual - either someone on staff (such as a systems administrator), or someone from outside the company whose opinion you trust (perhaps a service provider, or perhaps the lead developer at your friend's startup, etc.). Find someone who doesn't actually want the job, but who has the skills to help you narrow things down. Trim out the people who obviously aren't qualifie…
Personally, I this kind of work terribly tedious, at best. One would have to pay me at least double my normal rate.
The traditional model might call this role an "in house" conteract recruiter, and I doubt the good ones get paid what a good programmer or sysadmin do, thoug perhaps they should.