Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
ipfw is a kernel extension and as such is always on. the default rule list has only 1 rule - allow all inbound access. The gui in "system preferences" is for an application firewall not related to ipfw.

I use "waterroof" to set rules for ipfw.

http://www.hanynet.com/waterroof/
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.