Just remove songs from the Library in iTunes and upon syncing your phone it will remove them from the phone as well.
If you want to edit songs just right-click (on PC) > Get Info. You can also get album arts by right-clicking and selecting "Get Album Artwork" and it will get them instantly from the iTunes Store! Just make sure your songs are labeled correctly.