iTunes/iPhoto automatically resizes your photos to somewhat larger than 480 x 320 size. I think it's a reasonable design choice on Apple's part, although perhaps having an option to set photo size would be nice.
You can alternatively install Apache on a jailbroken Touch, and load whatever photo size you want with that, and then use Safari to view images on your Touch.