Should I be worried about the heat that tethering causes?
Normal, just like you modem at home heat up during high traffic, the PA (power Amplifier) is active more than normal which cause some heat dissipation. Your battery is being drain at higher load as well,,which reduce efficiency which is equal to more heat.
nothing to worry about, iPhone have heat sensors and it will shot down the phone if you reach any dangerous level