Space between sections in table view

I'm trying to set up a grouped table view with no headers and footers. The view has multiple sections but each section has a huge gap between them. I tried changing the header/footer heights to be 0.0 but this didn't change anything. How do I remove some of the empty space between sections? (Similar to the sections when editing a contact)