While I don't use Dictation as often as others, and have no objective data, subjectively, I found the download/results well worth the effort. Other than a bit of HD space, I am unaware of any downside. And yes, IMNHO, the ensuing dictation is much faster and smoother.
So I say give it go!