Ah thanks Dave, that did it!
I just find it a bit annoying if I'm trying to double click on a file to open it, I end up clicking on one of these arrows instead. I got my first Mac 5 years ago and just recently upgraded to the iMac Retina, and forgot how I had turned this off.