Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
In that case turn everything off, and then start turning one by one and see which one is using location services all the time.

In my case it was passbook
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.