I thought of that when I read the OP, since it isn't clear. Since I'm unaware of any setting in native Mac OS X that would enable a caps lock alert, I assumed the OP wanted to add one, rather than wanted to disable one. Do you know of any setting that would cause an alert when caps lock is enabled? "Play user interface sound effects" in System Preferences > Sound doesn't do it.