Even though Oliver's presence gave them peace of mind, that didn't mean they relaxed. There was no doubt that they were in a dangerous situation, no matter how much it seemed like they had the advantage.
Since the event at the Cannaris Empire's elven village, Andrew had been training his strength and although his power increases came mainly from the release of his divine seals, that didn't mean he was weak in combat.
He certainly wasn't the most powerful expert in his category or could defeat higher-level experts like the protagonist in many of the novels he had read in his past life, but that didn't change the fact that he could defend himself.
This is understandable since he is not a God candidate with combat proficiency, so it is normal that he does not have many skills in this field, but he made up for it with the strange versatility of his skills.