I've only felt condescension in that question when amongst a group of people I already believed (or assumed) would be looking down on me anyway. Most of the time in my experience it's been a way to break the ice and get to know a person.
That said, I dread the question for two reasons. The main reason is that I usually have to explain to other people what I do. Everyone knows what a doctor does, a police office, a lawyer, a teacher, etc. But tell someone you're a Graphic Designer (which I am) and the look on their face is blank because they have no concept about what I do. At best, they think it relates to computers. Thankfully, we are well past the 1990s because trying to explain amberlith, mechanicals, typesetting and god-knows what else would be really onerous.
As it is, I have to actually explain what I do before most people get it. Problem is that I did what I do for 19 years in newspapers, so it wasn't your typical graphic designer job of logos, stationary and business cards. Now I work for a company that designs yardage books and scorecards for golf courses. The response then becomes either "That's a thing?" or "oh, yeah, I guess they'd actually need someone to design those things." Because you know, that stuff is just there, no one thinks about how it got there.
The other reason I dread the question is because once you start the drudgery of explaining a lot of people check out. It's not interesting at all to them and they really just asked the question to be polite. Getting into it wasn't exactly the conversation they wanted to have.
But yeah, it's what I do and it's what has put food on the table and paid the bills for 22 years now.