Why buy such a powerful phone if you are not going to max out its capabilities?
Do you buy 16 Core Xeon processors to use 10% of it? There are some AMAZING games on the App store that easily take full advantage of the GPU & CPU.
I have an app that is able to doo real time fft analysis while already using 30% of the CPU. The cpu difference is easily noticeable just from App Loading.
No, YOU are the one with the wrong device if you are not using it to its fullest capabilities.
EDIT: Even on a very basic level you can see a difference in loading times of apps:
Now imagine doing more with your phone and the difference the CPU makes.
Also 3D touch was a big + and from iOS10 we can see them starting to take more advantage of it.