Yōga Sūtra 2.04

Ignorance (avidya) is the breeding ground for other obstacles that are dormant, weak, intermittent, or fully active.

Out of the five obstacles, ignorance is the primary one as it is breeding ground for others.