I just assumed that the OP was encoding from a Blu-ray rip and that when he said the source file was only 13GB that it was from the internet and had already been compressed. We really need to know from the OP what his source is and weather it's been re-encoded already.
A HDDVD rip is going to be smaller that a Blu-ray rip simply because the physical disk holds less data, 15/30GB for HDDVD vs 25/50GB for Blu-ray. Early HDDVD films were more heaverly compresed to fit on a cheaper single layer disk. I have yet to see a Blu-ray rip thats under about 18GB.
I agree the Handbrake encoder does a wonderful job of deciding which areas of a file need more or less bitrate, but you've still gotta give the encoder a fighting chance by setting a sensible bitrate/CQ to start with. Set it too low and I don't care how good the encoded is your gonna get poor results. Until we know the bitrates of the OP's source and final output files we're just guessing as to his problem.
The smallest HD encode I have has a bitrate of 4600kbps and a file size of 4.13GB. I would never go any lower than that because the results just don't look as good, but thats just my own personnal preference
A HDDVD rip is going to be smaller that a Blu-ray rip simply because the physical disk holds less data, 15/30GB for HDDVD vs 25/50GB for Blu-ray. Early HDDVD films were more heaverly compresed to fit on a cheaper single layer disk. I have yet to see a Blu-ray rip thats under about 18GB.
I agree the Handbrake encoder does a wonderful job of deciding which areas of a file need more or less bitrate, but you've still gotta give the encoder a fighting chance by setting a sensible bitrate/CQ to start with. Set it too low and I don't care how good the encoded is your gonna get poor results. Until we know the bitrates of the OP's source and final output files we're just guessing as to his problem.
The smallest HD encode I have has a bitrate of 4600kbps and a file size of 4.13GB. I would never go any lower than that because the results just don't look as good, but thats just my own personnal preference