Xu Mu wasn't flirting with the women; it was merely a casual joke. The deeper one's cultivation, the less desire one tends to have.
Compared to improving cultivation, momentary pleasures aren't worth mentioning.
Ordinary people like this whole area mostly due to the inherent desire to procreate. Lower organisms place a greater emphasis on procreation.
Their lifespan is short, so to perpetuate their bloodline, they need to reproduce quickly and in large numbers.
For example, insects reproduce several times a year, producing hundreds or thousands at a time.
High-level creatures are less concerned with this as they have a longer lifespan.
For instance, humans, even the ones very capable of reproducing, only have a handful of descendants.
Cultivators are an even more advanced lifeform, with even less desire to reproduce.