Found it!
This is apparently a side effect of the upgrade; it keeps your previous Finder customizations, which means no Quick Look icon. Customize fixed it! Thanks!
you can customize the control bar and add it yourself! I did not even know about this feature- Right or control click where the icon should be and choose "customize toolbar" and add it yourself, it works a treat.