Do you actually turn it off with the whole "slide to power off" or you just tap the power button to basically put it on standby? The iPhone has to use some charge to restart and to initialize all of its components. Now the 4% loss may not be all that accurate, but it may lose ~1% or so even if the indicator may not reflect if fully charged.