The gamers didn't attack. Instead, they tried to sneak into the prison to lock themselves up. That was a good thing, as the guards of the Castle weren't attacked.
The gamers were busy defecting and sneaking into the Castle in a bid to become famous slave warriors. Who had the time to attack the Castle? The few gamers who wanted to attack the Castle were unable to break the defenses and cause any harm.
The gamers of Victoria City tried all sorts of ways to sneak into the Castle to defect, even at night.
The gamers who got into the Castle weren't released. The Duke was reluctant to kill these gamers since they were fearless warriors. Where could he find such warriors?
The gamers were locked in cells. Recently, more and more gamers climbed over the walls, swam through the moat, and disguised themselves as commoners in a bid to get into the Castle. Within a week, the prison cells of the Castle were flooded with Victorians.