You continue walking to get to the castle.