Hover your mouse over the preview in Mail, a small drop-down arrow will appear to the side of the preview. Click that and choose Convert to Plain Link. (see screenshot below)
They really should make Link Previews an option in the preferences.
View attachment 2114258