Nobody cares about the voting of posts anyways, so it's a moot point.
You can do only once per post, no big harm can be done; be your guest. Just ignore the number. It's a relict from times where unneeded down voting could be compensated. Just ignore.
Did you up-voted yourself