Kain didn't immediately leave the cavern with the others, instead he headed over to the pile of rubble that had once made up their ally.
The others had assumed after seeing the explosion and the absence of any intact core that the "golem" was dead. And that would have been true if it had been a golem in the traditional sense.
However, unlike the others, Kain knew that while its body was destroyed, what truly controlled it was not any kind of core, but rather some kind of microorganism. Otherwise, he would not have sensed any kind of pull from his affinity towards it.