Well. It will always have some delay.
It needs to wait for two clicks to invoke multitask bar. Back when there is no multitask, click home button once and it will go home instantly. You can try setting triple click in accessibility to see how long it will take to go home. This time it will have to wait for three clicks so it will have a long delay. Hope this help.