I don't think what you are doing is ridiculous at all, in fact I myself strive for that myself but in a different way.
The reason why many people love it (me and my family included) is that they don't think of it as technology but as a product.
In my family we are two grown ups, a 7 year old and a 3 year old. Google Home understand us all first time in most cases. The ones where it doesn't are so rare it's note even 5% of the time.
I look for technology which:
1) removes the layers of abstraction when it comes to interacting with it.
2) Helps with banale tasks such as weather (can't be underestimated, when you have kids), starting some random music (Play smooth jazz, play Pat Metheny, Play dance music), play latest episode of "Startups for the rest of us", play the news, timer when you cook, add things we need to buy, ask something we are unsure about.
3) Gives us back some of the tangibility of the physical products.
All these things can be done via your phone, but once you have a voice interface you realize how much faster and less intrusive it is.
These voice interfaces are not yet good enough for really detailed needs but for our mostly simple needs.