Xavier wanted to scare Noah because he could see why he was so good with her. For him, Alice's happiness came first, and being her brother. He wanted to know Noah's true intentions.
"What will you do if I tell you I like her" Noah's words shocked Xavier.
Noah could see through Xavier's motive behind interrogating him. But he wasn't that easy to scare. He was only being kind till now because he was Alice's brother, but that didn't mean he would doubt his intention towards her.
Xavier let out a chuckle making him frown. He knew it from the beginning when his investigator told him about Noah and how he was always following his sister like a secret protector.
First, he was very angry with Noah's actions toward his sister, But when he kept learning more about him, his actions didn't turn out to be suspicious.
All he found was Noah following her to her studio and then following her back to her apartment where he lived.