To Kimura Kazuki, the Jorōgumo had indeed left a deep impression on him. The Jorōgumo had fled immediately after the Soul Summoning Pencil awakened her conscious mind. She had run away due to her Yokai's instinct of responding to fear, as at that time, she could sense the threatening aura and killing intention from Kimura Kazuki.
Back then, it was proven that running away was the right choice. When she was running away, she saw how Kimura Kazuki manipulated his flying sword to kill dozens of monsters in the blink of an eye, which gave her and the other monsters quite the scare. She was lucky enough to survive by avoiding the fate of being beheaded.
Therefore, she recognized Kimura Kazuki as soon as she saw him. She did not attempt to attack, as she knew that it would be pointless. Kimura Kazuki's strength was not something she could counter. Thus, she was left with the last option: behave herself! It seemed to work pretty well.