I haven't seen any option to turn that feature off. I'm sure a jailbroken app will let you remove the "new" tag.
When first setting up a restored iPad it is kinda odd to see every app with this tag, but it does make it easier to figure out what app has been opened and which I still need to get to when setting up my settings in the app or signing in....