The other side of the camera

Why is it that all photographers that Ive ever met hate having there photo taken?
Why is it that we are scared to show our selves on the other side of the lens?

It got me thinking.....

They say ever image is a self portrait, if this is so then why are we scared to be on the other side of the camera surely there is less exposed there???