I have scratches on my iPhone 4S too... Still irating. I can cover them up with a bumper.
If you return your iPhone, you may end up with a problematic phone ( bad pixels etc ). That was my decision not to return it, not to mention, the time it will take to get a replacement. Apart from the scratches, my iPhone works well, personally, I'm not taking the chance of more serious problems with a replacement.