I'm having the same issue, running a 2017 MacBook.
It takes between 17 and 23 seconds to switch a user. This is much longer than it took on Mojave. It doesn't seem to make any difference if the user was previously running or logged out.
[automerge]1570727895[/automerge]