donate to mac the ripper to get beta access to the newest version, which will bypass some of the newer encryption. That's all I know. I haven't done it yet.
wish I could help, but ive noticed some newer titles arent working with handbrake as well. and usually I dont care enough to do anything bout it, ewwww standard definition!
Im guessing the DVD has that ARccOSS encryption on it.
although Mac the Ripper can deal with ARccOS encryption. it cant do everything. there are some DVDs with that encryption that it cant touch at all. my best bet is to use DVD Shrink which is a windows only program. you'll need to emulate it or use boot camp to use it. DVD Shrink has solved most of my encryption problems back then. but since im a mac user now i use MTR