You always have control and if you say you don't, what do you say about the people who are attracted to little kids? Are you willing to make an exception for them and say that is wrong or are you going to explain how they can't help who they are and we should accept them and stop being hateful?
You can compare the way homosexuals and pedophiles both have no control over their sexual attraction, sure.
But the difference in what's inherently wrong about pedophilia isn't the attraction itself, but its repercussions. Child rape or producing child pornography is the main problem. It's just inacceptable since children are too young to give consent to something as serious as sex, and adults who abuse them are often in a situation of power.
Homosexuality, on the other hand, doesn't necessarily involve abusing anyone. As long as both are consentual partners, what's the issue?
If you really want to make an analogy with pedophilia (not that you should), a more accurate one would be to compare it to an homosexual raping an heterosexual: one is sexually attracted while the other isn't, and there's no consent.
Even then, abusing a child is worse IMO, but that's still a more accurate analogy.