It should not slow everything down. That said, I am not upgrading as it is a new OS, there are still known bugs, and many of my apps don't have Big Sur support yet. I'll probably upgrade in another 6 months provided that software support comes through and later revisions run smoothly. I don't recommend immediately updating to a new OS when it first releases without having a clone of the previous OS and a willingness to spend the time downgrading should an issue arise (that said, ideally one should have a clone anytime they update an OS on any platform). Even with Apple's great infrastructure for development and testing, it is impossible to anticipate every little issue.