His grudges with the families of the Heavenly Realm, when added up, did not actually run deep enough to warrant their relentless pursuit of him to the death. To be honest, even if he were already a true immortal, which he is not as he hasn't even reached the level of a Daluo Golden Immortal, he would still not be considered a significant enough threat for those major clans and sects of the Heavenly Realm to pay such close attention to him. Even though Zhuge Changping of the Zhuge Family had died because of him, that was merely a feud between the younger generations within the family.
When viewed from the perspective of the entire family, it's not insignificant, but certainly not a cause for a clan-wide vendetta.
Which great family doesn't lose members? Which major sect's core disciples never fall?
If every death of a core disciple led to a clan fighting a life-and-death battle with the offender, then the entire Cultivation Realm would probably have descended into chaos long ago.