Why is iBooks font size universal?

I have several ebooks on my iPad that have different font sizes. If I change the font size in one book and then switch to another, the font size is changed there too. I feel like the font size setting should be specific to each book. It's annoying to have to change it back and forth as I switch between books.