Took my son's SE in for the cheap battery replacement about 5 months ago. It did not seem to perform any better than the old battery. He recently told me it would not turn on, and when I took a look at it, the battery had obviously expanded, pushing the display up from the frame in the middle.
Seems like we got a defective replacement battery. Took it to Apple, new phone (refurb) within 10 minutes. Great customer service, as I have always experienced.