I tried to delete songs on my iPhone4 via iTunes but when I right click no menu opens and pushing the delete button on the keyboard doesn't do anything as well 😕
Did you set iTunes to sync devices automatically?
If so, uncheck it in Preferences>Devices and you should be able to manage your iOS device library once connected.