If a CD is scratched/dirty it will import much slower than a clean new one. Also some copy protected CDs will import slower. And the complexity of the music will also affect the speed.
If you've enabled Error Correction in iTunes importing preferences theat too might slow down importing.
Last, but not least, other processes/applications running while importing may also take its share of CPU cycles, thus reducing speed further.