Brian Stark understood what they were saying. It meant that they were the ones who were gossiping in the mansion without knowing that Amy had been listening to them.
He turned towards them in a rage, ready to end every last one of them, but Amy fell to her knees, begging him not to kill them, as they were the closest things to a friend that she had.
Amy implored him to let them live, and in return, she would not hurt herself or try to run away, and she would be with him but he had to give her some time first.
The sudden realization of her parents' death was still a shock to her and so she told him that she needed a bit of time to sort out her emotions and if Brian Stark could grant her this wish, she wouldn't stand in his way.
At least, that was her plan until she could find a way to escape from the mansion on her own.
As Brian watched the tears stream down her cheeks, he couldn't bear to see her in such a way.