Those servants from the court might be in a low position, but they worked for the King, so they clearly knew the rules here.
Lord Huai was grounded because the King preferred the Crown Prince and wanted the Crown Prince to marry the Phoenix Girl. However, Lord Huai and the Phoenix Girl were engaged, and the Phoenix Girl only wanted Lord Huai. That was why the King thought of this idea and tried to make Lord Huai disappear gradually from the capital.
Things had been going well, since Lord Huai was grounded whilst the Phoenix Girl moved around in her mansion and sometimes met the Crown Prince, but the Phoenix Girl went to Lord Huai's Mansion to meet Lord Huai personally!
All they saw was the Phoenix Girl and Lord Huai's servant speaking with each other, which made their mission easier. They could even tell the King about this and the King might grant them a bonus.
However, after a short while, Lord Huai and the Phoenix Girl were almost hugging each other.
