You should be able to do a simple swap without any mods. If you are currently using a Fusion Drive, I would look into defusing them first before making the swap.
Personally, I wouldn't open the iMac and replace the HDD with another HDD. I would replace it with a SSD, and if I needed a lot of storage for cheap, I would just use external storage.
That is just me though.