I tried to delete songs on my iPhone4 via iTunes but when I right click no menu opens and pushing the delete button on the keyboard doesn't do anything as well
Did you set iTunes to sync devices automatically?
If so, uncheck it in Preferences>Devices and you should be able to manage your iOS device library once connected.