Why not just give them a different address, such as your work or school address? Using the address you specify for Wi-Fi calling is about fourth in the list of how you will be located. Furthermore, even if they have the correct home address, are you sure you'll be home for your next emergency?