OK, just to get an official definite answer I called Apple Support which has always worked great for me.
There is no issue in restoring a Time Machine Backup to the new SSD drive coming from my Fusion Drive....However, the Time Machine Backups will not longer work correctly to restore backups on the new SSD once the OS is restored.
You need to make new Time Machine backups from the SSD drive for it to work correctly which is not a problem.
Once I've migrated my backup to the new SSD from Time Machine, I'm going to wipe the Time Machine drive and use it for the new SSD installation.
Hope this helps someone also looking to do this.