just tried it, no problems
You're hearing the noise each time you push the battery in? (it takes a few seconds)
and putting the lid back on after time #5?
it should beep again after you put the lid on.
I did not remove it from the find my app first, you might try that if you haven't removed the old entry.