The 2009 Mac Pro dual CPU does not have the slot mechanism and uses CPU's without an IHS. The 2009 single CPU models do have the slot mechanism. The same goes for 2010-2012 Mac Pro's, single and dual CPU models.
I think the picture on the left is a 2009 dual CPU heatsink, the one on the right is a single CPU heatsink.