Arcane Familiars, Spirit Crystal Servants, and other external entities, at lower professional levels, indeed provide considerable help, but when one reaches the Legendary level, they are more likely to become a burden, a weak link that powerful enemies can target. Most of the famous spellcasters do not have Arcane Familiars, and even if they do, they are created temporarily, specifically for a given task, and are disposed of after use.
I have simply taken a more radical approach, totally abandoning this ability in exchange for two entirely different systems of spellcasting.
When reclaiming the Soul Consciousness from the Spirit Crystal Servant, it was like pulling up a radish and bringing out the soil along with it; a series of Special Abilities from Death Roar were abruptly pulled into the Soul Consciousness and into the Arcane Soul Tower.