Caches store information that can help speed up some operations that have already been done in the past. They are safe to delete, but will result in a short-term performance hit until the caches have been recreated.
If you're deleting them just to save space though, there's not a lot of point. It will only help in the short term, because the caches will just be recreated again when you you repeat the tasks that originally created them.