Get your roommate noise canceling headphones. Or go into a Best Buy and Staples and test click every mouse.
I suspect your roommate may be bothered by any clicking sound no matter how soft it was. Maybe you need a new roommate or to use your computer in a different room?