Your brain is decelerated by the wall of your skull as you end the movement in one direction. At the turning point of the shaking, switching to the other direction, you develop a considerable force which is applied to and absorbed by your brain.
That's why.
HTH