Yep, I really hate touchwiz but you lose a lot going to a vanilla rom. I did have some debloated touchwiz roms that ran okay. I liked the moto x for the fact that moto updated very quickly and the phone was designed to enhance pure android rather than skinning it completely. I'm curious, did you get the 6 or 6+? I really went back and forth on this one. Note3 was just too big for me but 4.7 seemed a tad small. The M8/S5 are close to perfect sizes to me.
Considering 6+ is slightly skinnier than Note 3, I think 6+ will suit me well. If Note 3 feels too big for you, then I'm not sure.