If you're trying to import an .mov or avi file it will take hours as it has to decode the entire video.
If you're pulling in from a digital camera it takes a little bit shorter than the actual video itself.
There is no drag and drop feature that you're looking for because video editing software has to put the file in a format it can work with.