My Magic Trackpad also needs to have its batteries recharged more frequently than the Bluetooth keyboard - perhaps anywhere from 2-4x more (although it partly depends on my activities - usually, the trackpad is getting more use than the keyboard).
However, I've heard people remark that something seems to be wrong with the way that the trackpad detects how much battery life is remaining. If you watch the percentages, it goes down from 100% rather quickly and will begin to warn you of low battery, but then the percentage begins to drop very slowly. I haven't kept track of the exact dates, but I know that I've gone for at least two weeks while the "low battery" warning was going and didn't have the trackpad fizzle out on me. I did a test to see how long it would take for the trackpad to stop operating, and it was long enough that I had forgotten when the indicator came on.
To summarize, people who claim that the trackpad only lasts 3-4 weeks between charges are usually going based off of when the "low battery" indicator starts up. Based on my experience, you can go for another 2-4 weeks beyond that.