The rest of the audience doesn't know that Sam is the one under that cloak and mask fighting against White.
For them, he is a complete stranger who just happened to be a pain in the ass. A pain in the ass that messed up their plan to destroy Stone. But now that they saw how good he is against White, they became nervous.
Most of the audience are from the Noble League and they are already having a hard time with existing talented people. Sam's presence itself caused them a bunch of headaches.
At least, White is somewhat in control. But they are planning to kill off Sam with an elaborate scheme for a while now. But now, there is another guy who popped out of nowhere.
This is bad news for the first graders.
Stone just looked at the match with excitement and once in a while he savored the ugly looks of the Noble league people.