You will need a $20 adapter from Apple to get an external monitor to work. The adapter goes from the mini VGA to regular VGA. DVI is not an option.
When you say that the eMac is super cheap, are we talking sub $400 super cheap? If not, have you considered a mini? The refurbs are pretty cheap. If you can stand the slower hard drive and lesser video then that may be better.