Jose was having a hard time. He was conflicted. He already knew that he had not been informed of everything regarding The Strauss/Bakers situation. The woman came back, but he was not there when that happened. At the time, he was already suspecting people were holding info from him. At that moment, he knew for sure.
It could only have one explanation: they knew he and Claire were having an affair.
He never meant to let things get to this point. Yes, she was hot and he wanted her since the first moment he set his eyes on her. But he knew better than to pursue a woman of another social class and, on top of it, a suspect of a crime.
But she kept appearing everywhere he went. It made things too hard for him, because she smelled great, her eyes gleamed at him in a way no other woman ever had looked at him. He tried to ignore her, and leave, whenever he saw her around.