1. Select all the songs of the album, press CMD-I so get the info-window, set the album artist field.
2. Then select the options-tab on the right (inside the info-window), select "part of compilation", hit ok.
3. Press CMD-I so get the info-window again and deselect "part of a compilation", hit ok.
Strangely enough this worked for me. 🙂