After seeing the Wolf Leader in a near-death situation, Adam knew that once they had slain the other two wolves, Luke would bring up the bet they had made after hearing each other's conditions.
Adam never believed Luke would be able to kill the Wolves because he suffered a significant amount of damage from simply wolf cubs, and what they were talking about over here were the cubs' parents, actual Wolves. It was obvious that they would be on a greater level than them. So, how could Luke, a Bard, defeat them without suffering any kind of damage, whereas a Swordsman could not?