"No need, I will return to my estate now" Ryden refuses again
The most that Ryden and Clyde can do was to ignore the Empress and all of his previous crimes and only that. They don't have the intention to be close with him
In fact, if not for safety's sake, they wouldn't even spare the Empress at all
It's just that if they were to go against the Empress then Kervy would be in an awkward position
Without the Empress, Kervy would be hard pressed in maintaining his position
Not to mention, having a full blow war against the Empress is not a good thing as it spelled danger
Clyde and Ryden has become ruthless in their ways and means throughout the year but their goal still remained and that is to live their life peacefully
Fighting against the Empress would make it harder for them to have a peaceful life and the duration would also be long