Turn off bluetooth on the iPhone (for real, in settings not control centre), make sure wifi connected on the watch and then start the update from it.
Think it sometimes goes via bluetooth with the phone
It prefers updating over Bluetooth for some reason and Bluetooth data transfer speed is SUPER slow. Like others pointed out if you can force it to Wi-Fi it would go MUCH faster.