Pounding heart and anxiety when drinking milk or higher fat foods

When I drink whole milk or other foods with a modest fat content within 10 to 20 mins my heart starts pounding and I get an anxiety feeling along with the feeling of having to clench my teeth. My breathing picks up as well (but not hyperventilation just a noticeable increase). This effect from these foods can last about an hour from the time they start.

Does anyone else experience this? If so do you have any idea why? This has been going on with me for about 3 years and doctors just look at me like I have two heads and I get the typical "hmmm, I've never heard that before"