The Obsidian Throne Ruin isn't just a simple ruin of old buildings or architecture. The real ruin is under the ground. As for the old ancient Castle, it was nothing but an old tall architectural structure with no value at all.
There might have been a time when there used to be valuable things in the castle but not anymore. William estimated that in the next 50 to 100 years, half of this castle wouldn't even exist anymore. As the locals have started taking stones from the castle for their own personal use. If things keep going in this direction, then the castle won't be able to hold its weight anymore and will eventually collapse.