This is a problem with the HTC IME keyboard. If you really need that character i would suggest a different keyboard like 'better keyboard'. Unfortunately the HTC keyboard is probably the best tap keyboard you will try. IMO it is much better than the stock one. If you can do without a tap keyboard, I would suggest swype. You should be able to find a version with a quick google search as its not in the market. I just checked and it definitely has this character.
EDIT:Just found some colorful swype keyboards real quick
http://www.droid-life.com/2010/05/05/download-5-additional-swype-colors/
O and for the people that dont like the sense launcher, LauncherPro is awesome.