For the last few days Xavier had seen Agatha trying to talk with him but the fear that she might ask divorce after how he reacted that night scared him to have a conversation with him.
That night, he said many things to her that he never meant. Yes, he was scared. He was scared that Jeremy wooed her over and she might leave him. Afterall he was never a good husband to her. She had no reason to stay with him. But her leaving him was like a nightmare to him. He couldn't accept it and ended up bursting and blaming her.
After cooling down, Xavier regretted every word he said but his fear that Agatha would ask for them to separate made him avoid her completely.
Like always, he noticed her eyeing at him but he acted like he didn't notice her and talked to people as usual and escaped the crowd. As soon as he finished his talk, it was already late.