Jimmy is right. If it's a brand new phone, it's not going to work until you plug into iTunes and agree to your two years.
A phone bought of craigslist or ebay, however, will be fully functional (minus cell service, of course) without having anything to do with AT&T.