As William expected, not a single one ever dared to follow him. William was able to take them down, but he saw that the cost of doing this wasn't profit worthy.
The same number of elixirs he'd consume to do so was enough to shake a grand gathering of the enemy just like here. Besides, that grand gathering of the enemy was enough to secure lots of them out if they wanted to run away. But they didn't. And that told William that much scarier force was heading towards here.
If they wanted to take him down, then he'd prefer to keep them running and chasing like crazy around them, taking them all over this part of the forest, running in circles, while taking down lots of monsters and spirit masters in the process.