OP is just afraid of rejection.... Something that keeps many men lonely and single. Its an ego thing, they are too inflated to risk being deflated.

And good thing, it keeps the weak men, cowardly men out of the way.