The Normans began to make incursions into South Wales from the late-1060s onwards, pushing westwards from their bases in recently occupied England. Their advance was marked by the construction of castles and the creation of regional lordships. Pennard Castle was built at the start of the 12th century after Henry de Beaumont, the Earl of Warwick, conquered the Gower Peninsula and made Pennard one of his demesne manors. The castle was constructed on a limestone spur, overlooking the mouth of the Pennard Pill stream and Three Cliffs Bay, and was protected to the north and west by surrounding cliffs. The fortification initially took the form of an oval-shaped ringwork,, with a defensive ditch and ramparts around the outside, and a timber hall in the centre. A local church, St Mary's, was built just to the east and a settlement grew up around the site; a rabbit warren was established in the nearby sand dunes. In the early 13th century, a simple stone hall, approximately, was built on the site of the older timber building, using red-purple sandstone with white limestone detailing. Around the turn of the 13th and 14th centuries, while the castle was controlled by William and his son, also called William, the timber defences were replaced. A thin stone curtain wall, approximately tall with battlements, replaced the palisades, with the mural defences including a square tower on a rocky spur on the west side, and a circular tower on the north-west corner. A gatehouse was built as the new entrance, with two half-circular towers that possibly imitated those of regional castles such as Caerphilly; it was weakly defended by a portcullis and a handful of arrow loops. The new walls were built from a mixture of red sandstone rubble, probably quarried locally, and limestone dug from the castle site itself. The Braoses may have rebuilt Pennard as a replacement for their castle at nearby Penmaen which was abandoned at around the same time due to encroaching sand dunes.
16th-21st centuries
Pennard Castle also began to suffer from sand dune encroachment and the castle and its settlement were gradually abandoned. A survey in 1650 described the fortification as being "desolate and ruinous" and surrounded by sand. By 1741, the castle's south wall had mostly collapsed but the remainder of the castle was apparently still generally intact, although it had suffered further losses by 1795. It was a popular subject for engravings, sketches and paintings from the 18th century onwards, with the view of the ruins from the east proving particularly popular. By 1879, large cracks had appeared in the southern tower of the gatehouse, which led to its partial collapse. By 1922, concerns had grown about the condition of the castle and discussions took place between the Penard Golf Club, who owned the site, the Royal Institution and the Cambrian Archaeological Association. A joint committee was formed to raise the funds for repairs to the stonework but the costs appear to have been excessive and instead the gatehouse was patched with concrete between 1923 and 1924. Much of the remaining southern wall collapsed at the beginning of 1960 and an archaeological survey was conducted between 1960 and 1961. Urgent masonry repairs were then carried out in 1963, paid for by a combination of the Ministry of Public Buildings and Works, the Gower Society, the golf club and a public appeal launched by local newspapers. In the 21st century, the ruins of the gatehouse still survive, reaching up to the battlements on its east side, partially because it was built with very strong mortar. Parts of the curtain wall survive, mainly on the north and east sides, now around thick and averaging tall, along with the remains of the square mural tower. The ruins are protected under UK law as a grade II* listed building and a scheduled ancient monument.
