Earlier quoted context omitted.
I have big hands and I still agree with you. I hung on to my Nexus One well past its expiry date because of the size of it. Eventually I had to move up and being in the Android realm I came VERY close to buying the Moto X because of its narrower form factor in my hand. In the end I went Nexus 5 but it still feels big to me.
I've still got my Nexus One, though I almost clicked 'Buy Now' on a Nexus 5 today. Mind doing a comparison?
Versus the N5, you lose your removable storage and battery, the N5 will feel a bit too big and, though not as bad as Samsungs or the N4 (also LG), a bit plasticky. And for whatever reason they put the headphone jack up top which is irritating. It doesn't come with that nice sleeve nor headphones.
Google does not offer personal engraving on back of the Nexus 5, so no "hello world" for you. No Google-sanctioned car mount or desk dock either, you have to make up your own mind, which is frustrating.
But the screen is excellent, makes you feel on top of the world to have all those pixels. Thin. Plenty of horsepower, plenty of XDA attention, the battery is not horrible but you may end up investing in a cheap portable charger, particularly if you're accustomed to carrying spares with that N1.
It feels powerful enough to really do computer stuff, kind of. Makes you wonder if phones have peaked. Goes nicely with a Chromecast, screen casting and beaming 1080 movies you acquired somehow to your television.
That, and a table of specs you can find elsewhere, is basically it..