William the Conqueror began the building of Chepstow Castle in 1067. It was seen as an important defensive position against the the Welsh. The castle continued to expand through the 13th century.