Without his swords Walker's opponent was completely conceived he had won. He puffed up his chest showing off his strength and body covered in bruises. This was a show of his body's toughness, no other could penetrate his skin! Throwing wide aarcs with his fists he was basically playing with Walker, he was in the spotlight and wanted all eyes on him, not others could take his attention, there were no other fights going on.
The audience was tired of this playing and had begun to shout for an ending, their voices coming together to shake the walls yet again. Full of confidence and the taste of victory Walker's opponent came in for a massive punch to end the fight. This was exactly what Walker wanted.