The apps are not on your watch. They are on your iPhone. So you have to wait for the signal from your watch to your phone saying the app is needed, then send the started app info back to the watch.
The loading time is compounded when your watch app relies on accessing data from the internet and the data network your phone has is not fast. for the same app my loading time can be a few seconds to "forever", depending on network conditions