My girlfriend and I finished watching this last week and we both really enjoyed it. Your summary of the show pretty much nails it.
Thanks. We just finished it up last night and the ending was good. Glad it was not over the top. I imagined something much worse from a tragedy standpoint than what happened.
Significant Spoilers Follows
When you look at someone like Danny Rayburn, you realize that he was blamed unfairly as a kid and as an adult, and was abused and never forgiven by his father. He was told not to do what he did, take his sister for a boat ride during a family crisis, that ended in his little sister's death. I understand how the family would blame him, but the second tragedy was the Father was not able to move past it.
For this character, I have to wonder, was this the basis for all the later mistakes Danny made in his life? Maybe and maybe not. He was not outright ejected from the family and was given help to find a career, although there was a cycle of him returning and leaving.
Ironically, in an effort to cleanse his guilt, retired detective Lenny Potts, gives Danny some interview tapes, which Danny proceeds to obsess over and appears to be the trigger, for more bad decisions. I just have to wonder if this event was the thing that pushed him towards the significant mistakes he made in his life. I realize that we all make mistakes and some are more prone to bad choices anyway. I've seen it in my own family, but not to this extent.
Although I enjoyed the series, too much time was spent on the setup. I got it by episode 4. Things don't start popping until episode 9.

The tensest part of this story was when in an effort to help his brother, John tipped him off to a sting, this combined with his brother running drugs through their family business. I imagined it all crashing down on the Rayburns.
A plot question- I thought Danny owed a loan shark in Miami money and this was who he was sending his envelopes to, but it was revealed that all the packages ended up in a pile in his Miami apartment. I'm not sure about the significance of this. Money sent to himself, to his son, to be used to pay his debt later? Not sure.