I believe a 2014 Mini with a fusion drive will have a 128gb SSD portion (regardless of the size of the HDD portion).
In that case, what I'd do is:
1. DE-fuse the fusion drive into "standalone" SSD and HDD drives.
2. Install Catalina onto the SSD portion, along with your apps and basic (i.e., "stripped down") account
3. Keep "large libraries" of stuff (movies, music, and pics) on the HDD portion. They don't "need the speed" of the SSD.
My prediction is if you do this, the overall performance of the Mini will "jump up" to very usable. You'll have to get used to that "second HD icon" on the desktop (easy).
Actually, if it was me, I'd be using Mojave instead of Catalina.
Which is what I'm doing with my 2018 Mini...