It looks like it pulls it from your contact info. If you change it there does it change it in ApplePay?
It initially pulled the address from my contact info, but changing it there didn't do anything. I added a new address, and made it the default, but I don't see any way to delete the old address.