It signifies concealment, and Western society does not trust people who conceal.

Just if you were wearing sunglasses at night. People think you are concealing something, and feel you are concealing, like a criminal would do.

A funeral veil would be an exception, because you're expected to conceal your grief.