At first, Elliot didn't know that Loraine Shu was not his grandmother and believed she was one. But he couldn't love his grandmother even though Loraine seemed to love him and provide for his daily needs. Getting good treatment from that woman, of course, Elliot was happy and treated her like a family member. Unfortunately, his love for Loraine was outweighed by his affection for Jamie.
Maybe because he was so young, Elliot had a better sense than adults. He was compassionate and could feel who loved him sincerely and who didn't.
Elliot could feel Jamie's unconditional love without any ulterior motive. If he did something wrong, Jamie would reprimand him and give him the sense that what he did was bad.
While Loraine Shu… Elliot didn't know why, but he felt that woman only wanted to play with him when he wasn't naughty. When Elliot started feeling cranky or throwing a tantrum, the woman immediately disappeared and was replaced by Song Lei, who disciplined him.