Be thankful OP. If the kid fell asleep and cooed and smiled each time you held it, the mother would be beating down your door to beg you to babysit it. I'd throw the vibe back to the kid that "I don't like you either, so there! Humph!" Don't make any eye contact with the kid, don't even acknowledge it's presence. When the topic is on baby, bring up your own kids or a kid that you get along with. Talk about their soccer skills or things they did as a baby. The re-direction of energy will let the kid know he is not the center of the universe the way he thinks he is.