Even though the Coyote tribe army was the closest to his camp, they were still more than 2 days away from his camp.
So, he had quite the time to go have a look at them, deal some damage to them, and return in time to face Young Master Fjord.
Even though his team was made of 20 members from his Harem Palace, each of these ladies was extremely well trained and disciplined.
Roy had personally introduced and checked up on their progress, skills, and discipline from time to time in order to truly stuff it inside their heads.
Discipline was one of the main stratagems for an army, and not only. Even if they were just a small team of 22 women, man, and beast, they could cause a lot of trouble to their enemy as long as they followed orders.
There was also an important rule that Roy had instilled inside their heads during the training, if he didn't actively ask for them to serve them when they were out, none of them could approach him.