Just to clarify, what sort of alert comes up when you track the device?
I did find that under Location Services in settings, you can turn on a Status Bar Icon that will show up when someone is tracking the device. It was off by default on my phone and my wife's, but maybe your son turned it on?