When you say “turn off fitness tracking”, what features do you mean?
There is step counting, stand counting, movement, and exercise. Of those, steps, standing, and movement likely take minuscule computation to track. They just use some basic hardware sensors that the phone uses for other purposes. It doesn’t really take a noticable amount of power to read that data and calculate steps.
Exercise can take more power, though most of that would be either reading your heart rate on you Watch which would hit the watch battery, or for exercise like running where it uses the GPS that would use either your phone or your Watches battery. Since you need to manually invoke an exercise, that is up to your to control.
If you want to, you can turn off the notifcations for the stand, step, and exercise goals and rings. I do that as I find them annoying but that is the only reason for me.
If you have an iPhone 15 Pro, it’s already got a very good battery life. If you have unusual demands for battery usage and you have no opportunity to do on the go charging, there are probably other areas you might be able to save some battery that would be more effective than fitness tracking.