Be aware that the battery level shown is an APPROXIMATION only. There's no real way to gauge how much energy is still left in a battery (it's not like the fuel tank of a car; there's no "liquid" to measure.)
Solution: just use the mouse until it goes dead, and never bother with the battery indicator (I've had it show a negative number for remaining power......) Then just change the batteries. To make it last a bit longer you can use the power switch at the back, but in my experience that's just a waste of effort really; my magic mouse still lasts for many weeks on one charge even with the switch left in the "on" postion the whole time. I only switch the mouse off when I'm transporting it, so it doesn't wake up my computer while still packed in the laptop bag.
Others have suggested rechargeable Eneloop batteries. I use these too; avoid using very high rating NiMH batteries in stores; these typically have very high self-discharge rates and will go flat inside of a few months even if you don't use them at all. Eneloops will hold their charge for a long time, and is thus better suited for use in low-power devices like mice and keyboards and such where you don't want to have to change batteries all the damn time. 😛
Apple's own battery charger comes with six Eneloop cells (re-badged); it's not the best charger in the world maybe (or the cheapest, lol), but it's decent enough, very small and easy to pack in a bag, and it works. I use it myself to re-charge my magic mouse's batteries.