Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
Try using , Hey Siri set your volume to xx%. Rather than, set the volume. But I’m just guessing here, I’ve not tried it.
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.