The simplest and shortcoming answer is that the one who undergoes accelerating forces move slower through time. It's the acceleration (or as stated above, change in velocity) that causes time dilation, not the velocity itself.