Distrust
It was their only enemy there, but for Arnold, it was something he lived along with. People always doubted him when it came to decision making. His plans, decisions, advice, were accurate most of the time yet people who didn't know him well always distrusted him. Right now, in front of him was a man just like that. A man who wanted to challenge Arnold to show him 'his place'.
A man who believed Arnold was just lucky bastard to be able to defeat Tiamut and wasn't stronger than any S ranked warrior. Not many believed Arnold to be the SS ranked warrior as the Blacks claimed that he was. Why? Because his true strength had never been tested before.