Both About This Mac and Activity Monitor's Memory tab show 4GB of RAM being used.
Go back to Activity Monitor and add up the values for "Free" + "Used" ("Used" is already the sum of "Active" + "Inactive" + "Wired"), and see what total you get. My guess is, it'll be a number less than 4 GB. (I've heard that the real max amount is somewhere between 3.1 and 3.3 GB).
(I don't remember what Activity Monitor looks like in Mavericks; the used / free memory totals may be displayed in a different manner. Still, you should be able to find the correct number by adding the right values together.)
The problem is that that machine has a chipset with 4 GB of addressing space total. Since some of that addressing space is used to access other devices on the motherboard, not all of it can be used for accessing RAM.
EDIT: Drat! The newer versions of Activity Monitor don't bother with a "Free" value.
Hmm. Probably the easiest thing to do would be to use a different mechanism; for example, if you run "top" from the command line, and add up the "used" and "unused" values after "PhysMem", that should give you a more accurate value of how much memory is available. Hopefully...