What made surviving to Chaos magic so hard, even for its caster, was the fact that it would strike at its target and drain it of all of its light element until the Chaos turned into darkness, making the spell hit three times.
The first damage would take place when Chaos struck, the second once the lack of light element would cause a toxic imbalance in the body, and the last when the darkness element produced from the Chaos would spread without encountering any resistance.
Casting a Chaos spell was not only so demanding in terms of mana that even Eldritchs took care of not using them indiscriminately, but also extremely dangerous. The slightest mistake controlling it would induce madness.