Wang Wei knew why these people were hesitating about making a decision: fear that he or other people would have access to their sect's inheritance. Little did they know that he had already most of their faction's scriptures. He created the library mainly to preserve his sect's status in the world; he only brought it up to give others a similar opportunity.
The library took a lot of effort from him as he hid it in a special dimension composed entirely of Void Power, similar to the Void Battlefield. It would be difficult to affect this place since it's technically outside space-time — even if the world's timeline or history was wiped out once again.
Wang Wei even left protection to prevent people from using karma or the River of Fate from affecting it. Before leaving, he will influence the world's memory so that they will forget the library's existence; even Heavenly Dao will only vaguely know of its existence.