The last statement wasn't entirely true. There was a time when the duke enjoyed socializing.
Before Desmond was Desmond, he was a social butterfly. Many times in his life he got into trouble because he couldn't keep his mouth shut according to the headmaster at the orphanage. If he wasn't in trouble for talking, he was in trouble for talking back to authority.
Luckily, he learned to keep his mouth shut before dealing with Count Mikael.
As the duke, he had no choice but to listen more than he spoke. It would make his life much easier if he could bark orders like the other noblemen. It was frustrating having to quietly whisper an order so someone else could announce it for him.
A few times he even broke down and said what needed to be said for efficiency. He always regretted it when it felt like he had swallowed razorblades.