As long as the public decision passes, everyone can expel this guy from the town district and prohibit him from living here again.
The public decision has legal effect; it's not child's play. It is a part of the Japanese grassroots autonomy system. The fact that Japan can change prime ministers so often and still maintain social stability is thanks to this kind of community-based autonomy system.
Of course, town district public decisions are rare, because generally no one would provoke such public outrage to the extent of being directly sentenced to death. With the increasing control of the central government in modern times and the continuous improvement of laws, it's even rarer to hear of such cases.
At most, something like this might have happened in some remote mountain village, but it's almost impossible for outsiders to know about it.