The Goddess of Disorder was full of motive power. She almost immediately started to bewitch Gou, but she was still cautious and didn't explicitly mention the "Church of Disorder."
Setting aside whether the people she had brought along for the crossover still existed in this era, if she appeared as a preacher, then the church could certainly not be named with the word "disorder."
This was because the fate of the Righteous Gods was yet unknown, so it was crucial not to reveal too much too soon. Secondly, who in their right mind would name a church dedicated to justice "disorder"?
Wouldn't that sound unmistakably like the work of villains?
Which villainous organization would recruit people with "I am a villain" written all over their faces? What if someone reported them!