It does make a big difference using Geekbench battery test and most likely on a day to day use, worst thing that can happen is an iOS update might make the Samsung chip a better battery saver... lol
Worst thing that can happen, is that the next iOS makes the TSMC less efficient, so that Samsung and TSMC have same battery life.