It could only be said that Thor had come to Earth this time to deal with "family matters."
That was why it was inconvenient for even Thor's most trusted Sif and the Warriors Three to intervene.
Last time, Sif and the Warriors Three had rushed over when they realized that Loki wanted to exile Thor.
Now, Thor was the only heir and Loki had lost all chance of inheriting the throne.
The situation had completely changed. There was no need to worry about Thor's safety at all, so there was naturally no need for his generals and soldiers to follow him.
If the two brothers had yet another family conflict, these subordinates would be embarrassed.
What could they do, except continue watching?
Luke also felt that a lot of thought had gone into the Chitauri finding Loki.
Although the second prince wasn't a biological son, he had grown up in Asgard, and he would know some top-level secrets.