Taro was frustrated; a bit angry as well, however, he was more frustrated than angry. Abhirami's actions were clearly taking a toll on him, to the point that he regretted offering his help. Now that she's allowed to carry a phone, he didn't have to accompany her, which gave him that much needed peace of mind.
Even though he basically ran towards the Holy Land ditching all of them, he tried monitoring them through the window of their room. However, their room doesn't give him the view that he needed, therefore he headed towards the roof and hid there.
There he saw Abhirami headed straight towards the bus stop, spending no time lurking around the Holy Land for the first time in many days. Since the others were coming, he got down from the roof and headed back to the room.
