I suggest looking at your usage. If you restore and then setup using your iCloud backup then you're putting your phone back to how it was today.
Just like a computer, if you have a lot of things running, your system will slow down. With the phone, I think mail slows things down. Especially if you have multiple accounts added or one account with a ton of archived mail.