I have always thought it has to do with spin.

So the Earth is always spinning, but we don't feel it.

v = d/t right? So t = d/v

Obviously, relativity and stuff, but yeah, we can't tell how much we are really moving and spinning, so to time travel you have to somehow not be spinning for a period, or spin faster.