It wasn't strange for people to increase their physical abilities through training. In fact, almost anyone could do it if they tried hard enough. But it was a very slow process. The amount of time and energy spent for just a little improvement made the process almost not worth it.
Only a few people had the diligence and consistency to hone their physical abilities and skills to a very high degree through physical training. These dedicated individuals were revered as masters in their own fields. They were admired for their hard work and discipline, standing out among others.
From what was known, it was really hard to increase one's ability just by pushing physical limits through training or dungeon clearing. There was always a limit to how much one could improve this way. The progress was painfully slow, and many gave up before seeing any significant results.