I was told by AT&T that a phone number had to be associated with a phone. I hate the different answers that we get. It seems that it's not a lot to ask for consistency.
Yes, you'll need to put a dumbphone on the dummy line, not leave it hanging as a true dummy line. Fortunately, they're cheap to get or you could even dig up the old Razr and use that.