I believe their current fastest GPU in the iPad Pro is roughly around the level of a lower mid range PC card (e.g. GTX 750) from 2013 or an Xbox One/One S from that same era (impressive for a mobile device but that is an eternity ago tech wise and performance wise compared to the latest and greatest GPUs).
I think you can make a pretty big jump already by applying some similar logic as we do the state of their CPU performance. That A12Z which is equivalent to an Xbox One has 8 GPU cores and 6GB of LPDDR4X RAM. In a desktop, you can immediately ditch the low power part of this RAM, up the amount available and I'm guessing multiply the speed of it by quite a lot. My 16" MacBook Pro is running 2667MHz which is a factor of 10 over LPDDR4. That sounds like quite a boost to me.
I don't know how to compare the GPU cores in an A12 to the crazy numbers of specialised cores in a modern GPU so the best I can do is some very dirty extrapolation.
The GTX750 has 512 Cuda cores, Power = 55W
The A12Z has 8 cores, Power = 15W
These two are supposedly equivalent at 1.4tflops
I don't know how many GPU cores we can add in an iMac but I reckon its a few. The iMac Pro has a Radeon Pro Vega 64, the desktop variant of which has a TDP of 250W. I'm sure the smaller version in the iMac is probably a lot less so lets halve it to 125W. (The iMac Pro supposedly uses ~430W all in. The top end Xeon in it is 140W, allow another 100W for the rest of the unit and you still have ~200W left for the GPU so 125W seems potentially conservative, at worst its reasonable)
The A12Z cores look to be around ~1W each, assuming the active cooling can compensate for any non-linear scaling in watts per core, We could add over 100 GPU cores to an iMac SoC. Lets call it 80 for simplicity. Thats 10 times what the A12Z has and with 10x faster RAM. Potentially it could also have 10x more RAM for all I know.
That gives us 14tflops which would put it equivalent to an RTX 2080ti.
Like I say, this is a very dirty calculation with some pretty optimistic assumptions regarding core scaling, TDP, cooling etc. It doesn't include any improvements in the actual cores or a clock boost for them. It also doesn't factor in any equivalent Apple might have for the RT or Tensor cores that Nvidia uses or anything else they might have up their sleeves.
Even if I'm out by 20% or so, 11tflops is the regular RTX 2080. At any rate, its not a preposterously massive stretch that Apple can get some good graphics performance from their new silicon in reasonably short order.