> Is it that you prefer to hear both sides of stranger's conversations?

Yes. Hearing just one half is irritating, I think because I can't help expending brainpower on filling in the other side. A speakerphone conversation is much less annoying.