OK, today I still had the problem. I then killed the App Store app in the task switcher, logged out of the app store in the settings, and rebooted the phone. Then logged back in, opened App Store, and now the updating works. Yet another 8.4 glitch, I guess.