Thanks for the answer. I want to have three-finger swipe for mission control and that stuff so my only way to drag a file without clicking is to enable Dragging from: Accessibility/Mouse & Trackpad/Trackpad Options/Enable dragging.
But when I enable that, and you can try it by yourself the tap-to-click response is slower.
I believe you. I'm using the four finger option for Mission Control. For me, I find 4 fingers to be an easer gesture then 3 fingers. I'm new enough to the Mac OS that I didn't have any history with other gestures when I bought my rMBP.
I've been trying to keep a "just do it the way Apple says I should" approach as much as possible. That's just me of course.