too complex to use may affect usage negatively. too many features is not always good. trying to mimic real live brings the complexities of real life to the web. check this: "With Hangouts, the unplanned meet-up comes to the web for the first time. Let specific buddies (or entire circles) know you’re hanging out and then see who drops by for a face-to-face-to-face chat. Until teleportation arrives, it’s the next best…
When you enter your hangout, you specify what circle(s) see the announcement. So just make a "Everyone but Jerk" circle and post to that. He'll think you're never in your hangout.