I have different bands for different occasions for sure, but it's becoming less of an issue in my mind as the watch becomes more popular. In formal business settings I've seen plenty of others wearing the aluminum watch with a sport band, including CEOs of international financial companies. So most of the time I just wear whatever band I'm in the mood for on a given day.
My biggest concern in general has been not letting my watch stick out when that would be inappropriate. At a funeral for example. My space black series 4 with black sport band disappears when I'm wearing a black suit. My black leather band does the same, while looking a little nicer at the same time.
At this point I feel I don't need any more bands beyond the 5 that I have now. I've pined after the link bracelet since day one, but could never justify the cost. Of course, I received a bunch of Best Buy gift cards recently but they don't seem to carry it really (online only, and only for the smaller watch).