Everyone's patience has limits. He could tolerate it the first time, but he wouldn't put up with continuous, unbounded indulgence. Even if Carolline wouldn't know that he and Matilda Ferguson had another intimate encounter, he truly felt disgusted deep inside.
For some reason, Bryan Hawkins now found Matilda genuinely repulsive. If it weren't for his desire to drive a wedge between her and George Morris, and to let George make his move as soon as possible, he would not have allowed himself to face such a disgusting woman again.
Having said that, he managed to escape. What he didn't know was that Matilda did it intentionally.
She had thought about it. Perhaps drugging him had enabled her to get Bryan, but he would certainly hate her afterward. In case he became too agitated, she might end up getting more than she bargained for.