It's called field rotation, and yes, it's normal and expected. This is why you have to polar mount a telescope to do long exposure photography; viewing objects in an altitude-azimuth way shows field rotation. You can see this in constellations too; Orion looks like he's resting on his right side (our left) as he rises and he looks like he's resting on his left side (our right) as he sets.