vexare

Latin vexare meant physically shaking or jolting people, but also harassing or troubling them. That figurative disturbance underlies the annoyance or mental trouble expressed by vex.