Vaisesika Sūtra 5.1.05

अभिघातान्मुसलसंयोगाद्धस्ते कर्म ॥५॥

The impact is due to the movement arising from the conjunction of the hand with the pestle.