You can do either; it's up to you. I think both OWC and iFixit make kits to replace your optical drive with an SSD or HD (you buy the actual drive; the kit takes care of mounting and connectors).
OTOH, if you want to keep the optical drive in place, you can just swap the HD out for the SSD. Thing is you'll have to control the disk drive fan if you do that because the stock HD has a temp sensor on it, and when that gets unplugged (as will happen with an SSD install) the fans go full speed. I don't have a DIY Fusion Drive, but I did replace my HD with an SSD, and I bought HDD Fan Control; works like a champ. I think there are some free apps out there that will do the same for you, but maybe not as user friendly. Finally, you can also short the connector on the temp sensor. I didn't know this was possible when I did my install and probably would have gone this route, but oh well. Check this link for more:
https://forums.macrumors.com/threads/808178/