My OS X app has a main window and a preferences window. Both are modeless. If a window from another app is brought over the preferences pane, it disappears. It's not behind the covering window, it's gone. Finding the main window and clicking that brings back the preference pane and so does clicking the icon on the dock.