On Windows I noticed if you enable the sidebar (CTRL S) then resize it (sideways), you'll notice that the album art scales a little bit in order to conserve the same amount of columns until it gives up and changes the number of columns.
Likewise if you simply resize the main window. It's kinda dumb that you have to resize the window to change the album art size.