All I see when I log in as guest is the Drop Box in various accounts. I'd be surprised if your guest account allowed more. You'd need to have set permissions explicitly for that to happen.
Edit: yes, the drop box is normal, and you can alter that as well.
Go to the Public folder in your home account, click on Drop Box, Get Info, go to the permissions section, and set that of Others to "No Access".