If it's a program that you are talking about, run through the uninstall procedures. VPN's normally require an uninstall since they need to attach themselves to the internal driver for the network. Just dragging it to the trash probably won't uninstall the inner workings. Read the README that came with it.