We determine the non-abelian composition factors of the finite groups with Sylow normalizers of odd order. As a consequence, among others, we prove the McKay conjecture and the Alperin weight conjecture for these groups at these primes.