Remember those male genitals are on the outside, so that means they are more notices then us females genitals, Remember it his home also, and that means if you have a mother and her daughters over that, he can still be naked in the house.
One big difference between women and men is the correlation between mind and body arousal.