Not only the palace had been affected by whatever was happening that day. Words were quickly spreading throughout the whole kingdom. Some also had to experience it firsthand because the rogues hadn't just appeared out of nowhere. They had stormed into the kingdom, and it seemed like they were trying to leave their impact everywhere because they destroyed whatever lay in their path. They destroyed stalls, beat up people, and even captured some that caught their eye.
This also meant that the rogues had been active in combat with the palace guards out there. So while the guards were innocently out to catch a fleeing Damian, they had no idea what was waiting for them, and since they were not prepared for battle, the rogues won most of the fights.