I have the same issue and I believe this is google chrome related. I managed to fix the problem by going into Activity Monitor and "Quit Process" all google chrome related processes (e.g. Helper, Renderer, Worker, etc.). Simply closing the google chrome window will not work. This fixed my 20 second sleep problem.