Damien only went and saw Lynn for a little. No matter how much time it had been, nothing would change in how they interacted. Originally, she was his mother's Apostle, but once Claire's soul healed and she left for the Heavenly World, Lynn dedicated herself to doing the same for Damien.
She acted faithfully as his Apostle and never overstepped her bounds. That continued even now, when she was practically the Sanctuary's ruler.
Zara and Xue'er took up more time, along with the people around them.
Naturally, Xue'er wasn't very happy about his absence. For someone who was also family, she was kept separated from the rest for an unreasonably long time.
Of course, Xue'er had met the rest of her family members. Rose and the rest of his wives were able to take people in and out of the Sanctuary, so that meeting was always fated to happen.