The batteries are so cheap, and they last for a year - I leave mine in, so I can always track my AirTags.
If you think that you wouldn't be using one/several of your AirTags for well over a year, then it may pay to remove the batteries - to prevent any chance of corrosion.