Going to Key West, suggestions?

Will be in Key West for a week, looking for suggestions on things to do.
Some that I would like recommendations on:
Cuban restaurant
non-touristy (hard to find I am sure) restaurants
best conch fritters (mmm fried dough )
which sunset cruise to take
good coffee shop (cuban or regular)

Going with my wife and infant daughter, so not looking for the best late night party bars or bikini watching!

Any other ideas would be great as well. Mostly just looking forward to the first vacation in 6 years

 

Thanks!

Well, it I will be a tourist, just looking for SOME alternatives.

Like in Portland, Maine, the big touristy place on the waterfront is DiMillo's, but there is a little place around the corner called J's Oyster Bar that has the best lobster bisque for about 1/2 the price.
I took my parents to DiMillo's, because its what they wanted to do, but I take my friends to J's, because they would rather find the cooler spots.

I am sure we will go to Sloppy Joe's and Captain Tony's (the original SJs), just looking for alternates as well.