Sam might seem petty and he might be stooping low by acting like this. But he is also a normal human being. He is not a bigger man, who associates the other party's condescension to their immaturity and him ignoring them makes him more mature and a good human being.
He doesn't want to be that good human being and wait for karma to do the work for him, he pays back every debt himself.
In fact, he felt that him entertaining the other party by following the normal procedure of some, one vs one duel, beneath him. After all, he needs an equal to play, but the other party is clearly not at least in his mentality of looking down on people.
So, Sam is not going to bother with these rules and let all his soldiers loose. He followed them from a distance on his harbinger as he observed their movements.
