Hi,
I think the smaller/bigger buttons aren't meant to be used for setting font size when composing - they only appear by default in the main Mail window and are used for changing the text view size incase someone sends you an email with tiny fonts. The fact it works on the reply box is a bit of a mystery, but as i say i don't think those buttons were designed to be used when composing mail.