I've already added my Chase VISA (a Marriott Rewards card) to Apple Pay. I don't see any need to remove it and add it again.
I've been "on the road" for the past couple of months, and the only credit card I use is a corporate Amex that can't be added to Apple Pay. So, I'm having trouble even collecting the cash that Wells Fargo is offering if I use Apple Pay with our cards from that bank.
You don't have to add it again.