The Queue has been in the last three versions of Handbrake that I know of. In the new version with the snazzy interface shown above, it's fairly obvious how to activate it.
In the two versions before the current one (0.9.0), there's a little tick box near the bottom of the interface that activates the Queue function.