That's exactly what it's meant to be. Keep press a little longer and the iPhone will restart (release them once you see the Apple logo).
I think you are a little bit confused about what this "hard reset" does on the iPhone ...
It's just a forced restart.