You can do this in Photoshop, although it takes a few extra steps.
First, you'll need to create a duplicate of your image in a new layer. Then, go to "Select" in the menubar and choose "Colour Range
"
Now you can use the colour picker to choose the colours you want selected. You may have to click on a few different areas of the colour for it to select all of the colour.
On your duplicated layer click the "Black and White" adjustment layer button. At this point you should have some of your image in colour and some in black and white, but if it is the opposite of what you want then select the mask on the adjustment layer and invert it.
Of course, it's going to take a bit of playing around to get it to look just right. Also, if you want to remove colour that you don't want use the brush tool set to white and paint out those areas on the mask.
I know it's a bit convoluted to read, so I hope it makes sense.