Have you never ordered an adult beverage at a restaurant? They always ask me for ID and they usually stare at it for 20-30 seconds. Easily enough time to memorize just the street address, then they can google the rest.
I realize I wouldn't have to pay for fraudulent charges and I realize that this is unlikely to occur. I'm just saying that while I feel Apple Pay is a great option to pay, I'm concerned that if somebody wanted to, they could add my card to their apple pay account without me knowing. And I also realize they could take a photo of my card now and make an online purchase, but even with online purchases they also need a billing address.
Now of course once all transactions are completed at the table, this will no longer be a concern.
EDIT:
In addition to the above, on Apple's site it says: Apple doesn’t save your transaction information. With Apple Pay, your payments are private. Apple doesn’t store the details of your transactions so they can’t be tied back to you. Your most recent purchases are kept in Passbook for your convenience, but that’s as far as it goes.
https://www.apple.com/iphone-6/apple-pay/
So if somebody was going to put fraudulent charges, Apple Pay would be best to do it in a store in person in my opinion, because if somebody orders something online and it's shipped to a different address, that may flag something for a credit card company. But, in store in the same city I live in or same state even, my credit card company wouldn't likely catch it, and unless I'm constantly monitoring, I wouldn't likely know for awhile.