Though, it seemed slightly inappropriate to say that Lucy was fighting the buffalo leader.
Toz, Nil, and Scrael headed toward where the others were, fully thinking that Lucy was still busy and entangled with the other buffalo leader. Since, as far as they knew, Lucy wasn't as good at offensive magic as he was with mind manipulation and stealth. He was also pretty decent at making barriers, but that wouldn't help him end the fight with the buffalo leader any quicker.
No one expected Lucy to lose, even if he did stick to his promise of not using mind manipulation to kill the buffalo.
However, Lucy didn't even fight an extended battle.
Toz, carrying Nil, and Scrael, barely started walking before Lucy, Mindle, and Asilean appeared in front of them. The one thing that delayed them was dispelling Nil's magic.
Far from being stuck in a fight with the buffalo leader, Lucy finished his fight far earlier than Nil.