Me, too!
Benlee --
I have the same problem and its driving me nuts! Unless I basically shine a light directly on the keyboard, the backlighting is always on.
Then sometimes, in the dark, it'll turn itself off.
10.5.2 has made it dyslexic. I submitted a bug report but man, this is annoying.