If they are a member of your iCloud family and have sharing enabled, all of your Apple device locations will be visible to them under the devices tab. So it won’t matter what device is reporting back to your contact card. They can still see where your iPhone, Apple Watch, iPad are.