Apple should have adopted iOS home screen behavior for the watch. i.e.:
swipe left/right between glances
tap the crown on any glance to return to the watch face
tap the crown again at the watch face to go to the home screen with apps.
The whole "swipe up" should have just included the Control Center toggles and music controls.