You sure can.
just select the video window, and scrool up for forward and down for reverse.
You can also scrub by having the timeline selected and put the cursor over the playhead part of the window (sorry don't know how to describe it better) and scroll.