I think you're on to something.
I think Apple isn't necessarily going with the hardcore smartphone crowd with this phone; that is, the people who buy Blackberries, Treos, etc. and install lots of third party apps, use their Exchange mail with it, etc.
The smartphone makers have been trying to target consumers with their devices. Look at some of the more consumer-friendly blackberries, or more recently, the Palm Treo 680. The Treo 680 is clearly aimed at consumers, although the way it is is kind of half-assed ("look, it's a Treo you can buy in different colors! Consumers love buying stuff in different colors!").
Palm, RIM, etc. have been really trying to push the idea that consumer users want and should use their smartphones too, because it will of course greatly expand their market.
But the problem is, these devices aren't necessarily well suited for the average consumer.
Personally I like my Treo 650 ok, but I can't imagine giving it to a non-techie friend or family members, and explaining to them how to install third party apps, how to browse the web with Blazer, how to set up their e-mail accounts, etc.
But the appeal is still there; my mom for example was telling me she wanted a Treo like mine because she thought it was cool she could send and read e-mail on it, browse the web, etc. But I can't imagine her using the junky mail client my Treo comes with (and the third party stuff like Chatteremail is very good, but I think over her head).
But I think for this "consumer smartphone" market, that might what the iPhone is really aimed at, at least for now. People who like the idea of some smartphone capabilities, but wouldn't be well suited to actually carry a Treo or Blackberry around.
So I think that's why the iPhone's focus is on much smoother contact management, a nicer web browsing and e-mail experience, and photo, movie and music management that is really far ahead of what you can do on a Treo or Windows Mobile-device.