What would happen if an ordinary human decided to fight a Phantom? In a fair 1 vs. 1, with no hidden conditions or advantages for either side?
Well, the answer was very obvious, the common man simply had no chance of winning. The only exception that became possible relatively recently thanks to exoskeletons was that a military man could win such a battle.
However, for this a lot of conditions had to be met - a military man, although a mere human, but not a civilian, knows how to fight, especially in hand-to-hand combat.
The exoskeleton enhances the strength of the military, as demonstrated to the public at the Scarlet Light Fair, several of them are capable of defeating a White Threat Level monster.
Thus, if one of the best military, wearing an exoskeleton, faces some Phantom rookie, a real youngster that hasn't figured out how to survive in this world yet, the military can win, thanks to confidence and tactics.