Yes, you can use it while charging. It will probably be a little warmer than usual but that's normal because the battery is loading and the CPU, etc. is working.
"Overcharging" the battery is not possible, and you can't possibly damage anything while it's charging. Unless you throw it up against a wall, that is.