The Scandalous Duchess Who Was Banned From Her Own Castle (Inveraray Castle)

The Scandalous Duchess Who Was Banned From Her Own Castle (Inveraray Castle)

Margaret Campbell, Duchess of Argyll, arrived at her divorce trial in Edinburgh on February 18, 1963, dressed in a tailored black suit and three strands of pearls. Over 11 days, the court cataloged her love affairs in explicit detail, reading aloud from diaries that reportedly named 26 men. Her husband, the 11th Duke of Argyll, sought to end the marriage and keep Inveraray Castle, and his legal strategy depended on destroying her reputation completely. Born in December 1912, Margaret Whigham was the only child of a wealthy Scottish businessman.

Thumbnail

Her 1933 debut at the Savoy Hotel made her the most celebrated debutante of her generation. She married American golfer Charles Sweeney in 1935, and the couple divorced in 1947 after a marriage strained by his drinking and gambling. She met Ian Campbell, the 11th Duke of Argyll, in 1949. They married in 1951, and Margaret poured her inheritance into restoring Inveraray Castle, the historic seat of Clan Campbell.

She redecorated 17 rooms, installed central heating, and revived the formal gardens. By the late 1950s, however, the marriage had collapsed under the weight of the Duke’s heavy drinking and violent temper, and the couple lived separate lives. According to court testimony, the Duke broke into Margaret’s London apartment in February 1960 and stole her diaries and a collection of Polaroid photographs. The diaries reportedly documented affairs with 26 men, including politicians and aristocrats such as Duncan Sandys, then Minister of Defense and Winston Churchill’s son-in-law.

One photograph, showing Margaret in an explicit act with a man whose head was outside the frame, became known as the headless man photograph and was central to the Duke’s case. The trial exposed the double standard of British divorce law at the time. The Duke’s own infidelity was treated as a minor detail, while Margaret’s affairs were presented as evidence of moral corruption. Lord Wheatley, the presiding judge, delivered an 87-page judgment on March 8, 1963, describing her behavior as depraved and wholly unacceptable.

He granted the Duke the divorce and full custody of Inveraray Castle. Margaret was ordered to vacate the castle within three months. She made her final visit in June 1963, walking through the rooms she had restored before leaving permanently. She moved into a small flat in London and was financially dependent on a modest trust fund.

The identity of the headless man was never confirmed, and Margaret refused to name him, protecting him even as her own life was dismantled in public. The judgment effectively exiled her from polite society. Friends stopped speaking to her, and her children distanced themselves from her. Despite this, Margaret refused to disappear.

She gave interviews, wrote a memoir titled Forget Not, and spent the next three decades defending her actions and attacking the injustice of the trial. In her later years, she became an unexpected symbol for feminists who saw her case as an example of institutional misogyny. She maintained her grooming rituals until dementia took hold in the early 1990s. Margaret Campbell died on July 25, 1993, at the age of 80.

Her funeral was small and quiet. Scholars and journalists later re-examined the trial as a case study in how legal systems punish female sexuality while protecting male privilege. Inveraray Castle remains open to tourists today, and the current Duke, Torquhil Campbell, inherited the estate in 2001.

The castle’s official tour mentions Margaret only briefly, noting her divorce without discussing the scandal that destroyed her reputation.