If the monkey group on Fruit Mountain didn't have this territory, where they could find enough food, they wouldn't even have the luxury to brew Monkey Wine. They probably would have starved to death already.
Take that poisonous python and the giant bear from before. Even though they possess power comparable to a Pope Level in the outside world, they are still creatures that need to eat regularly, so they need to occupy enough territory to sustain their consumption.
The three giant bears are somewhat better. Even though they're large, they are omnivores. If they're really starving, they can still find enough fruits in the Ancient Ruins Space to fill their stomachs. But how could the poisonous python survive without enough territory?
Just like only the vast ocean can support a whale, without a large enough territory to provide food, that python, who consumes several tons of food per meal, would've likely starved to death long ago.
With that being said, the problem is obvious.