I used to leave it off and only turn on when needed. Now, I keep it on as I sometimes need to use my mobile network to, say, browse the web or play the game. I don’t notice a huge drop on battery life when I just leave it on.
Of course, when actually using Hotspot, the battery drop will be apparent.