Things would be different.
The Queen was, after all, still the Queen. She lost the authority token for an unexplained reason and if the token fell into someone other princess' hand, then the Weiyang Palace would eventually become an isolated place.
The King was not ready to conduct such a ruthless thing without preparations.
The Empress Dowager also noticed the unwillingness on the King's face, but she had made up her mind, so she said, "I am not saying that the Princess should take over the court. Have you forgotten why the authority token was given to me? The Queen is not in good health, so the token was given to me so that I can find someone to share the burden with her. When the Queen recovers, the token can be given back to her."