That's a dock connector cable, so it doesn't have the tabs that hold it in. Go ahead and pull it out. If you use a regular iPod cable with the iPhone, you will have to press the buttons on the side to release it.
The dock cable works just like the dock itself. 😉