I own an Echo and this is part of the reason it now sits unplugged. To be honest, it doesn't provide enough value for me to consider potentially compromising the privacy of my home.
Without trying being rude, surely this was obvious before you purchased it?
In short, we "feel" security more than we reason about it and once a risk has been personified we lend a lot more weight to it.