Oxwich Castle stands on a headland above the wide sweep of Oxwich Bay. The Mansel family built it during the sixteenth century on the site of a vanished Norman castle. The castle is one of the "sham" castles or a mock-fortified manor house built by minor gentry who gained power, prestige and property under the Tudor monarchs.

The Mansel family abandoned the castle in the 1630's in favor of a newer residence in Margam. Part of the castle and grounds were put to use as farmland but part went into disrepair. There remains a circular dovecot on the northeast side of the castle.

The site is presently conserved and maintained by CADW - Welsh Historic Monuments. It is a delight to visit and to explore what remains of this part of history.