After saying what he has to say, Vickers left the place. His promise to the empire was only guarding external threats, not internal threats and issues, and certainly not an issue that involves the fragile ego of the emperor.
He has to keep an eye on a lot of things himself. He came here so that he can show how serious he is about this whole thing and advise the emperor to not push Sam's buttons.
And most of it is because of some selfish reason. That is, he is not confident that he could handle Sam if he defected to the enemy empire.
That is right, he has followed Sam's actions and the most important observation he made was about his talent in military training. He can fight with the enemy emperor of his level, but he cannot attack the lower-level soldiers which would be unethical.
But if Sam is on the other side, he has absolutely zero confidence that the Orion could win.