The screenshot explains everything. Been happening since iOS 8. I've restored my phone and not restored a backup yet this keeps happening with certain people mainly people I've been in Group Messages with. The phone freezes for like a minute before I can actually message the person as well. I've deleted and unsynced contacts and it comes back once I add my contacts back through vCards after erased from Mac, iPhone, & iCloud.