Instead of conducting the scheduled audience in one of the foundations already built within the residence of the Royals, the Emperor ordered the audience hall to be constructed.
The aforementioned hall was located near the borders of the Imperial Palace. Hence, only the Royals and their servants, including a few of the knights and some officials, were the only ones who had seen the very interior of the Imperial Palace.
The Emperor took priority in keeping the secrecy of the personal lives of the Royals. Issues that could be detrimental to his ruling might arise if he didn't have significant control over what the public could see from the Royal Family.
Of course, the Emperor thought of that merely as a preemptive measure. More likely than not, the Royals would be held liable if they had been involved in any controversies. The Emperor wouldn't help clear the dirt on their names.