From what I've seen over years of reading computer and video card forums, there are three common reasons for this:
1) Card is failing. Replace card.
2) Card is over heating. Fixes include blowing out the dust, replacing the stock sinks/fans with improved aftermarket cooler, removing the heatsink and replacing the thermal compound, and improving airflow in the case.
3) Bad drivers, solved by a driver update (but I've only seen this about Windows, not OS X).