Even with it ticked it still doesn't update play counts. That's where the bug is.
Tried it on OS X and Windows and still doesn't work. I've heard it works fine from computers and Apple TV but on devices it doesn't even though it's suppose to.
Hmmm, strange. A lot of people got caught out by that little check box, which is why I posted it.