Presumably they refuse to own credit or debit cards for the exact same reason. Or work in any building which requires swipe-card access. Or shop in any mall which has security cameras...
Again - these analogies are poor.
When you make a purchase with a credit card - you are fully aware that you are sending your location to the company.
When you use a swipe card - again - you understand you are "checking in" and "out" of a building
When you shop at a mall - there are signs that you may be recorded and/or that there are security cameras in place all over the place for exactly this reason.
The argument here is that people's locations are being recorded and stored in a database which they had/have no access to and can't easily delete, purge, opt out.