I'm not aware of anyway to limit your app to a particular device. There is a parameter for your targets plist named UIRequiredDeviceCapabilities that allows you to set several device capabilities but all the values appear to apply equally to the all the iPhones from the 3GS up to the 5. Two of the parameters could exclude devices without and auto focus camera or flash.
I don't have time to try it, but perhaps if you only supply the higher height graphic that currently only applies to the iPhone 5, the app store would accept that and list the limit as iPhone 5 and iPod 5th generation. Apple might not allow that though as their scanner code might complain that a shorter graphic isn't available and therefore won't allow an upload to the store.
You can limit your build to iOS 6, which limits the devices somewhat. You can also set the target to be iPhone (and iPod) only. You'd still have to be concerned about supporting three resolutions; iPhone 3GS, iPhone 4/4S, iPod 4t/5th gen, and iPhone 5. You can exclude the iPhone 3GS by using using the front-facing-camera parameter.
One thing about those parameters. You must include them as requirements the first time you upload your app because you can not add them later on. For instance, my app doesn't have the requirement of a camera so a customer could end up downloading that for use on an older iPod. That wouldn't be good, but Apple won't accept the additional requirement.