The amount of anger inside Olivia's body was so magnified that she didn't even pay heed to Gandalf's words, even the new Queen's plead to forgive and let go. Haniwa didn't understand why she had to talk to Olivia, but because she respected her husband, she just had to. Olivia thought she was just a young girl trying to get into her husband's good graces hence she chased her out.
The palace wasn't a place for Olivia anymore, she spent most of her time tucked inside her chambers where she accepted no one apart from servants who cleaned her chamber pot and scullions who brought her food. Aryan made sure to instruct the kitchen wenches "I want her fed after every four hours" and indeed after every four hours the scullions knocked on Olivia's door and brought food to her.