If half you people ate like you profess to you'd all be anorexic. A little bit of milk isn't going to kill you and it sure as hell won't change your immune system to that of a bovine.

Just don't personally drink a gallon a week and you'll be fine.