Vaisesika Sūtra 5.1.05

abhighātān musalasaṁyogād dhaste karma ॥5॥

The impact is due to the movement arising from the conjunction of the hand with the pestle.