You should secure it in my opinion. It's analogous to leaving your doors open as not to inconvenience any visitors with having to knock or ring the doorbell.
People expect to have to enter a password, it's normal. It's not a good enough reason to leave it open.