Damien took out his sword - Knightfall and the Darksilver steel gleaned under the moonlight while making everyone feel a sharp sword aura emanating from it.
In Damien's perspective, Drake was just a junior to him who is too full of himself. He didn't want to waste his time by squabbling with someone who isn't even at his level. That is why he didn't even pay Drake much mind when he tried to stir up trouble for his first Alchemy class.
It's not like Drake was his sworn enemy, so he didn't want to create unnecessary hostility and disrupt his own life.
But that doesn't mean he would sit still if someone asks for a beating or tests his patience. Even though Damien didn't have any memory of his mother, he, for some reason, felt irked when Drake ridiculed him. He felt more anger even though the insult was to his mother. At least his mother was the reason he was even born into this world.