The FD in my Late 2013 iMac was very quiet as well.
Just share my experience on fusion drive.
I also have a late 2013 iMac in office. It's 1.12TB fusion drive has 128GB SSD. It works quite well and I can hardly hear its noise. But it started to crash frequently about 1 month ago. It at least crashed once a day, either unexpectedly rebooting or just hanging. All my other Macs use SSD and never show this kind of problem with similar configurations for web development. One of the reason I guess is maybe I open too many apps and too many tabs in Chrome at the same time. While on the iMac 2013, the SSD part is likely already or almost full, so the fusion controlling software has to switch frequently between apps and files, hence exceeding it capability.
Yesterday I decided to install High Sierra Beta on the iMac 2013, as I heard the new APFS can handle fusion drive better. The installation took more than 1 hour, comparing to 35 minutes on my mid 2012 MBA. I think it's due to larger drive and HD part of the fusion drive. After installation, the system became extremely slow. Installing Xcode 9 command line tools took about 30 minutes (I didn't count as I didn't expect it). I believed it was doing indexing work at the backend. It did gradually regain responsiveness and speed during my half-day use.
Today it got even better. It didn't crash once, the 1st time full day coding without interruption for a month. Some apps such as Atom and DayOne gave me problems intermittently, but overall no big issue. I even feel the system is snappier than under Sierra. It's a good sign to fusion drive and the coming new OS.
Of course I still prefer SSD, and my new iMac 5K 2017 has 1TB SSD. I also replaced HD to SSD for all my previous Macs. But the iMac 2013 is difficult to do so. I almost plan to change my office iMac. Fortunately, High Sierra Beta seems to make fusion drive work again at a more than acceptable level, and extend its lifespan.