Unfortunately that removes them from all of your devices, not just that iPad.
This also bothers me, I like my iPad to be free of text interruptions. I think there are only two solutions: either turn off Messages notifications, or sign out of iMessage in Settings > Messages > Send & Receive