You have to add your apple ID to iMessage on your iphone to receive messages on both devices.
Basically, for now, messages going to your phone # go to your phone, messages that go to your Apple ID go to any device which has iMessage setup with your Apple ID.
In iOS 6, it will be unified so even messages going to your # will go to all your devices.