I tried to delete songs on my iPhone4 via iTunes but when I right click no menu opens and pushing the delete button on the keyboard doesn't do anything as well
If you have your iPhone plugged in, select manually manage music. That way, you should be able to delete music.
How am I doing that?
When I do that it wants to erase and sync?? How can I apply without erasing anything?