This is normal behaviour for a backup set. Any new or modified file is added to the archive, but never replaces a previous version.
This makes it possible to recover an earlier version of a document, if for example the later version gets corrupted.
A common backup strategy is to periodically start a new backup set, and archive your previous one, preferably to an offsite location. If it gets too expensive to provide new media for anew backup set, you start recycling your backup media. eg wipe an old backup set and start a new one.
(eg if you are backing up to an external hard disk, you might want to dump the backup set to a CD/DVD and then start a new set on your hard disk)
Backup sets are written sequentially, and so it doesn't make sense to delete files within a backup set. It won't save space, because it won't be written over.