(Even they don't give me vibes as the white-robed master just left. He's probably from some reclusive sect that came down the mountain for some mission. )
Wang Wei doesn't know that one of the city guards almost guessed his mission correctly while judging him as a martial artist incorrectly.
Even if Wang Wei knows about that he will not care. As he's currently looking at all the markets in the town for the map of the yellow snake empire using his strong soul perception.
Wang Wei searched for two to three markets and found the map of the yellow snake empire. But those maps don't specify anything about the dead desert that he's searching for.
So Wang Wei stopped looking at the markets for information & map and looked at the famous antique shops in the town for the map or information that he needs.