Vernon had enough talk with Vincent as he knew it was going nowhere anyway. Vincent would continuously curse him for being the homewrecker, even though it was Vincent himself who ruined his family.
Chloe was a very tolerant person who forgave a lot.
At the start of his reunion with Chloe, Vernon admitted he was such an asshole. They had many unneeded confrontations and misunderstandings because Vernon thought that Chloe hated him, so he wanted them to burn together in pain.
But Chloe showed him nothing but gentleness. She was patient and loving, just like before they got separated, and his wrath slowly died down, leaving a bittersweet feeling as he wanted to repair his relationship with Chloe.
Now that he was at his best time with Chloe, he would not allow anyone to ruin it.