System preferences, International section.
Under the Language tab, make sure that your language is listed first. You can remove Korean or whatever pops up inappropriately from the list while you are there.
Under the Input Menu tab, make sure that only the languages you use are checked.