You don't need separate libraries for that. In your main library, make a playlist called "iPad" and another called "iPhone." In each playlist, place the songs you want on your iPad and your iPhone. Then just sync that playlist to your iPad and iPhone instead of syncing the entire library.
Same with movies, you can pick and choose which movies you want on each device.