The reason why these people had considered retreating earlier was mainly because they were scared!
The sudden blockage of their elixir field and the substantial drop in their realm level. At a time like this, if they could keep their mood entirely unchanged, then they wouldn't be human... they would be gods!
Even gods might not be able to guarantee that their mood won't change at all.
It's perfectly normal to have thoughts of retreating when frightened.
But now they suddenly discovered that Chu Mo, whom they had been hunting down, had appeared. Furthermore, he was being besieged by others. To say that they weren't moved would be an absolute lie.
If Chu Mo really was captured by that group and obtained the legacy, then they, these people, would undoubtedly be regretting to death!