Interesting. according to the tech specs pace, the 5700 in the Mac Pro supports 3 Pro Display XDR whereas the Vega II (Single) only supports 2.
the Vega II 'Solo' should do 3. ( I suspect it doesn't handle it 'well enough' so Apple specs it to 2 ). But back I/O card port + TB bus 0 + TB bus 1 should work ( as 6 DisplayPort streams ).
The W5700X has a more modern display driving hardware and can do DisplayPort data compression. So sends less data to support the 3 large resolutions and has a better raster pipeline ( since more targets at higher frame graphics at more mainstream resolutions. )