It seems the system is currently trying to boot to a new Boot Camp partition (created via the Boot Camp Assistant). Typically this is when you'd insert your Windows installer media and proceed to set up the new OS.
To get it to boot back to OS X without doing that, you'd typically need to get the unit to accept a key press on startup (Option, or Alt, should take you to the boot picker). In my experience, the way to go is to turn the unit on, tap the button in concern rapidly, then press and hold it when the chime sounds.
If using a wireless keyboard, start tapping before even starting the computer, and if you're still having trouble, switch to a USB model. Even a keyboard off a regular PC should do.