If you often do NOT have your time machine backup drive attached --- When you connect that backup drive, the backup process will read from, then remove the temporary time machine files that get stored on your boot drive in between those times that you connect to your backup.
So, you got some space back because you haven't backed up for some period of time, or you have made significant changes to your files since you last had that time machine drive connected.
Just Time Machine doing its job.