It might depend on the UEFI implementation, my Asus board refuses to boot without CSM when no UEFI GOP graphics card is present (it'll reboot and automatically reenable CSM). UGA video drivers are no part of UEFI spec, so I guess it's usually not supported.