From the start, Damien never planned to take more than a few days to deal with this unknown continent. There was another reason why he aligned his timetable with the completion of Apeiron's purge.
Earth.
It was a world that he had no connection to, yet was deeply connected to at the same time.
Actually, Damien wanted to abandon Earth after his mother moved to Apeiron. The world was simply too underdeveloped to be of use to him, and there was nothing motivating him to protect it.
Sure, it was his homeworld, but the good memories he had there were already by his side, so did he need to be sentimental about it?
Regardless of his feelings, however, Earth was a world bound to him and the first world he became the Star Master of. He couldn't just abandon it.
Now that he could communicate with that child, it was no longer a possibility.