Idri didn't want to turn this fight into an all-out death battle.
Although he can certainly win this battle easily if he goes all out, even he can't guarantee the lives of the ordinary folk in the dragon valley.
Even the weakest of the attacks from an SS ranker can slaughter millions of innocent people, and if Idri really pushed Neo to the point of life and death, Neo might cause a big ruckus that might affect the people.
This is Idri's home, and he doesn't want it to get destroyed from collateral damage; thus, he calmed down his anger and didn't continue the fight or ask an explanation for Neo's rude behavior.
This battle can be considered a casual spar for SS-rankers, as no one suffered any harm. Idri also used his world authority to heal the people who had gone blind from seeing those extremely bright attacks.
As there were no real casualties, Neo couldn't be punished for anything at all.