I suspect your objection may mostly fall into what I consider exceptions, such as things done in public spaces (although I don't think it's sustainable to assert that you give up
all privacy rights in public spaces).
> at the root there is no difference between me observing stuff and writing it down and a computer observing stuff and writing it down.
If that computer isn't talking with other computers, I agree. I actually don't have much of a problem with individuals making individual observations of public behavior and writing them down or storing them in a computer.
My concern is more about the parameters around sharing that data (mostly because of the existence of databases and data mining). Further, I'm far more concerned about data collected about me on the internet than in the physical public square.
That said, I do and will continue to go out of my way to avoid as much surveillance as possible even in physical public spaces. For instance, any store using those surveillance devices intended to analyze my shopping behavior, moods, etc., in order to target ads at me is a store I won't be stepping into.