nah.. there's convenience to be had.. i'm not exactly sure how the user interaction will be or what all you can do with it but if you can do things like tag purchases at time of payment.. tags go to desired spreadsheets.. etc.. then things like job tracking/invoicing will be way simplified.. paper receipts will be a thing of the past as all of that stuff will go to your computers/files automatically..
plus, simply not needing to carry a card around is a convenience in itself.
while this is true, i don't think it's much of an argument against pay-with-phone.. i mean, downloading angry birds increases the risk that you'll drop your phone more than applepay does.
again, i don't know all the details but aren't the banks still involved? won't they just keep dealing with fraud/theft in the same way they are now?
(or- i might not understand you exactly here.. i might need a rephrase

)