It was not uncommon in Nine Regions to have all sorts of conjectures about time travel. From the Supreme level cultivator close to ascend to immortality, to the storyteller in common tea house, all had their own conjectures about time travel.
Of course, they were all limited to conjectures only, because even the most enlightened cultivator could not manipulate time on a large scale. The Immortal Tea was just a legendary tale among cultivators, there had never been a true instance of time travel.