How fast is your internet connection? Or latency? In my experience, iPhoto 09 exhibited some contact with servers that would slow it down a little while after opening. They fixed it in an update, but recently it has increased the starting time.
What happens if you turn all connections off and open iPhoto?