Fabian wanted to earn the trust of the ladies. That is why he was very rude to them. Just like before when Fabian talked with Harold rudely while declining the invitation sent by Gilbert. At that time showing them rudeness, he send them away so that they could understand that he was a man of principle and character.
As Fabian declined that he would not help them with their trunks, the women were angry. But they didn't show it to their face. Then Fabian started escorting them to the main road again. He wanted to get out of there as soon as he can because the sun was about to set. And traveling in the night is not always a good thing.