Everyone in the village knew of Zemin Yan's existence, so every new person who claimed to be from the Song Family or Song Family servant was informed by the people of the village about the young Song master, who was still in the forest. The village people sincerely cared about the child so they warned these "Song Family" people to be rescued.
So there was always some cultivator or even some humble servant trying to hunt and capture Zemin Yan, those were long and terrifying days, hiding in small animal holes or inside the trees, hungry and cold, just waiting for these bad people intentions were gone.
The villagers came to regard Zemin Yan as a person with dementia who had been so traumatized that he would rather live with the animals than return to his wealthy family in the capital. Over time the villagers stopped talking about the young Master Song and the cultivators, after stealing everything they could, also stopped appearing in Village 10.