Well, the GPU was much better in the G4s, wasn't it? Also the G4 obviously has the AltiVec engine which will make it significantly faster for some processes.
If I ever had to choose between the two, I'd take the G4 every time because the G3s had some reliability issues.