I find this setting to be worded very poorly.
It seems to me that MY caller ID is on my phone. You know, it's the thing that tells me who's calling me? That's my caller ID showing their phone number. (Or so I'd think.)
But apparently not. It seems that my caller ID is what's on other people's phones. And their caller ID is on my phone.
Seems backwards, but whatever. I just think they could explain that a little better in the setting. Maybe call it "reveal my number to caller ID" or something like that. As it is, I thought that 'off' meant "don't show me who is calling me."