I did some testing and it seems that my microphone is bad. The ear speaker is also bad. I contacted Apple and my warranty runs out in 5 days. They are sending me a new phone.
I guess it was just a coincidence that this happened when I updated to iOS 9.