For those people, the moment she revealed the truth to them was the most they could justify their hate for her. She was in others' eyes perfect; she had everything. A rich family background, intelligence, and skills. What did a person like her who had everything had to fear? Setsura didn't know how many times she had to refrain herself from screaming. `how would you know?'
How would any of these people know what was happening? Just because a person is rich and on the surface seems okay, doesn't mean they are. They live in a judgemental society. Whether it is the Meiji era or modern-day Japan, that hasn't changed at all.