In this world, the second sons were practically nobody. They were no more than a substitute son. Ernest's value would only go up if the worst and unlikely case of Hubert not being able to inherit the title for some reason happened.
But as it was said, that case was very unlikely.
Ever since they were young, Castellan Stanislaus had been grooming Hubert to be the next head of the house. He received a proper education to be a leader, which he failed pretty often. These failures made the Castellan frustrated, but he never changed his decision.
Ernest, on the other hand, was the brighter kid among the children. He outsmarted his older brother on all occasions, only to be dismissed by their father. Innocent games and competitions would become a space for Castellan Stanislaus to criticize his youngest son.