Works for me when I hover the phone approximately 2” above the HomePod. I get a vibration and notification and it works great. Same is true for the reverse. Are you holding it too far? It might be trying to transfer but doesn’t quite make it. Haven’t tried transferring calls that way yet. I always just use the Airplay button on the iPhone call screen.