Hard drive folders viewing issue

Not sure how else to title this but when looking at folders on an external drive, you click on one and view its content and then when you click (or swipe) back, it starts up at the top (A) again! Is there no way to get it to stay where you are? Say in the Ls? Incredibly annoying to have to scroll down to find where you were every time you look in a folder and back out.