It was only in the last few months that the state of Ithadurna was ruled by Florentia. The attack that was led by Raphael at that time was unexpected and the Faction shift happened quickly. The majority of Ithadurna's citizens were Florentias supporters so the knights belonging to Duke Radcliffe also immediately surrendered when they found out that Raphael and his troops had power far above them.
Ithadurna was not a big source of money for Avalon at the time, so they tended to be neglected. Their land was barren, so humans were also reluctant to live there. They could not raise livestock or grow crops there. Some of Ithadurna's commodities were agarwood and sandalwood which were quite expensive. However, because of their limited number, they limit the number of trees that could be cut.