Hyperacusis is a physiological condition. It is a hypersensitivity to certain types of sounds. The nerves in the inner ear are in pain because of frequencies heard. There is a therapy to relieve this developed by a Swiss physician, Dr. Guy Barraud. This is explained in the book he wrote for layman called Hearing Is Behavior.
And no, you are not going crazy.