Is 2-pass encoding really worth it?

I use Handbrake to rip DVDs and the process takes over 2 hours per movie, which seems completely excessive.

Out of curiosity, is 2-pass encoding, which basically doubles the amount of time it takes, really necessary? Is the difference noticeable?

Thanks