I put a new battery on the 4s and on the screen there is only the drained battery animation. I plugged the phone on my computer but the phone does not turn on, I can only see the battery animation on the screen.
I would question the quality of that battery. New it should be in a stasis type state and holding a charge. You can use a program like ibackupbot on a PC or Mac to check it.