You're not connected to them; your computer is just aware of their presence. You will still need to authenticate in order to connect to them. They cannot connect to you unless you enable file sharing in your System Preferences.
But yes, if you have a wireless network, you should ensure that it is encrypted.