If it's a power outage in your whole area then everyone their phones switch to LTE instead of their WIFI which can result in lower speeds. It's also possible your closest 4G antenna is affected by the outage so you're picking up 4G signals from further away.
So yes, it's normal if your whole area is without power. If it's only your home then it's not normal.