Yeah, the app shortcuts that you add to the watch face are called complications. Putting the Voice Memo complication on your watch face will give you even quicker access to it than swiping for the Control Center.
You can also add it to the dock which will be quicker than searching/scrolling through your apps, but not as quick as a complication.