In 1917, the will of Oliver Hazard Payne left his nephew Payne Whitney sixty-three million dollars. It left Payne’s brother Harry, the son who had stayed loyal to their father through twenty years of a family war, a single painting. One Turner canvas that Harry had once admired on his uncle’s wall. Nothing else.
That was the cost of loyalty in the Whitney family, a dynasty that built its fortune on the streetcars of Manhattan, forty million dollars made in five years by men who leased New York its own trolley cars at prices they set themselves. What divided that fortune was not a crash or a bad bet. It was one uncle’s vengeance over a marriage he could not forgive. The story begins with William Collins Whitney.
In the 1890s, New York was the largest city in America, and the system that moved its people through the avenues and cross streets was the horsecar. Thousands of trolley cars threaded the blocks every morning, and as the decade turned, electric cars joined the horses. The network grew until it touched almost every corner of the island. But dozens of small companies each ran a handful of routes, and no single owner controlled the whole system.
No single owner could set the price of a fare or dictate terms to the government. The network was enormous and disorganized, and that combination was the condition William Whitney intended to exploit. Whitney was a corporate lawyer, a former secretary of the Navy under President Grover Cleveland, and a man who treated political connections and financial leverage as two instruments of the same trade. With a small circle of partners and the financial backing of his brother-in-law, he assembled what the corporate record describes as the first great holding company in the United States.
The method was predatory and efficient. Buy a small streetcar company, fold it into a holding company, issue inflated stock, and use that paper to purchase the next line. Repeat until the map belonged to him. By 1900, Whitney controlled close to three thousand streetcars running on three hundred miles of track across Manhattan and the boroughs around it.
The daily movement of the largest city in America belonged to a handful of men, and William Collins Whitney was the one who put them together. Then he turned the machine into something more private and made his real fortune. He leased the trolley cars back to his own operating companies at prices he set himself. He voted himself enormous salaries from the boards he controlled.
In about five years, he extracted close to forty million dollars from the streetcar system, a sum worth near eight hundred million in today’s money. The passengers who boarded those cars every morning paid a fare for a ride across town, and without knowing it, they paid for the construction of one man’s fortune. That fortune had a physical address. At 871 Fifth Avenue, Whitney hired Stanford White, the most celebrated architect in New York, and spent three and a half million dollars turning a private residence into a monument.
The ballroom stretched sixty-three feet long. Bronze gates hauled from a palace in Rome stood at the entrance. The marble floor was inlaid with ten thousand individual pieces of brass, each set by hand. Whitney entertained governors, railroad barons, and at least one sitting president.
No one in those rooms had any illusion about where the money came from, and no one objected, because the guests were the kind of men who intended to do the same in their own industries. But the streetcar fortune did not stand on William Whitney’s capital alone. Behind every acquisition stood a second fortune, far older and far larger. It came from Standard Oil, and the man who controlled it was Whitney’s brother-in-law, Oliver Hazard Payne, the treasurer of Standard Oil and one of its four largest shareholders.
When Payne’s sister Flora married William Whitney, Oliver gave the couple a house on Fifth Avenue and a million dollars in cash as a wedding gift. As Whitney’s empire grew, Payne stood behind it as the silent source of its capital, and the alliance felt like family and not just finance. When Flora died in 1893, the living thread between the Payne fortune and the Whitney household was severed. Oliver Payne lost his sister, and with her, the only person whose existence made his generosity feel like kinship rather than commerce.
Three years later, William Whitney took up with another woman and married her. Oliver Payne was consumed by the remarriage. He demanded that Whitney give up the new wife. Whitney refused, and Oliver Payne vowed to destroy him and never spoke to William Whitney again.
He found his weapon in the next generation. William and Flora Whitney had four surviving children, two sons, Harry and Payne Whitney, and two daughters, Pauline and Dorothy. The uncle went to each of them with an ultimatum: choose me over your father, leave his household, and when I die you will inherit one of the largest personal fortunes in the country. Stay with your father and you will receive nothing.
Two of the children chose the uncle. Payne Whitney and Pauline crossed the line. Harry Payne Whitney and Dorothy refused to leave. The fracture was complete.
William Collins Whitney died in 1904. His will rewarded the children who had stayed. Harry received half of the father’s estate. Dorothy received three-tenths.
The two who had gone to the uncle each received one-tenth. The arithmetic was a message. Oliver Payne lived thirteen years longer, and when he died in 1917, his own will delivered the mirror blow. Payne Whitney, the nephew who had chosen him, received sixty-three million dollars.
Harry, who had stayed with his father, received the Turner painting Juliet and Her Nurse and nothing more. Dorothy received nothing at all. The larger branch of the fortune went to Payne Whitney and became one of the most extraordinary accumulations of private wealth in the history of the country. He invested in banks, New York real estate, and thoroughbred racehorses.
The fortune compounded for a decade. Then on a late summer afternoon in 1927, Payne Whitney walked onto a tennis court and collapsed, dead within twenty-five minutes at fifty-one. His estate was appraised at one hundred seventy-nine million dollars, the largest ever recorded in the United States at that time. But he had been giving the fortune away.
In 1923, he wrote a single check for twelve million dollars to the New York Public Library, the largest gift in its history, and refused to let them attach his name to it. He gave more than twenty million to a New York hospital, endowing the Payne Whitney Clinic, among the first dedicated psychiatric treatment facilities of its kind. He gave a million to Yale University, and after his death his estate funded the Payne Whitney Gymnasium on the Yale campus. Harry Payne Whitney, the brother left a single painting by his uncle, was not destroyed by the split.
He combined his father’s inheritance with the wealth his wife brought to the marriage and assembled the greatest thoroughbred racing stable in America. His horses produced almost two hundred stakes winners, a record no other stable could match. In 1915, he sent an untested filly named Regret to the Kentucky Derby. No female horse had ever won the race.
Regret ran the mile and a quarter through the mud and crossed the finish line first, the first filly in the history of the Derby to beat the colts. Harry Payne Whitney died in 1930, his estate valued near seventy-eight million dollars. The uncle’s punishment had failed to do what it was designed to do. Then his wife did something none of the Whitneys had attempted before.
She tried to give away not money but art. Gertrude Vanderbilt Whitney had collected almost seven hundred paintings and sculptures by living American artists at a time when the New York art world looked across the Atlantic for everything it considered serious. She carried her offer to the Metropolitan Museum of Art. The proposal was straightforward: almost seven hundred works of American art, plus five million dollars to construct a dedicated wing.
The Metropolitan refused. The director cut the conversation short with a single line: we have a cellar full of those things already. Gertrude went home and put her money to use. She rented a set of brownstone buildings on West Eighth Street in Greenwich Village, converted them into a museum of her own, and on November 18, 1931, the Whitney Museum of American Art received its first visitors.
Four thousand people walked through the galleries on opening day to see the collection the Metropolitan had rejected. The third heir of the giveaway generation was Payne Whitney’s son, John Hay Whitney, known as Jock. He served as American ambassador to the United Kingdom, put money into Technicolor and helped bankroll Gone with the Wind. In 1958, he bought the New York Herald Tribune, believed it could be saved, and poured thirty-nine and a half million dollars into the paper over the next eight years.
The Herald Tribune published its final edition in 1966. The money was gone, the largest single documented loss of Whitney money on any undertaking. Gertrude Vanderbilt Whitney died in 1942, leaving behind ten and a half million dollars, a fraction of what the family had held at its peak. The streetcar empire had gone into receivership during the panic of 1907, but the family survived because the money had already moved on.
And inside what looked like total dissolution, something had survived that none of the Whitneys could have predicted. On May 5, 2004, a small painting by Pablo Picasso, Boy with a Pipe, which Jock Whitney had bought in 1950 for thirty thousand dollars, sold at auction for one hundred four million dollars. For a moment it became the most expensive painting ever sold at auction anywhere in the world. One canvas bought with Whitney money half a century earlier had become worth ten times the entire estate Gertrude left behind.
The institutions the heirs built still stand. The Payne Whitney Clinic treats patients in New York. The Payne Whitney Gymnasium holds its place on the Yale campus. The Whitney Stakes has run every summer at Saratoga since 1928.
And the museum the Metropolitan refused to accept sits today on Gansevoort Street, holding more than twenty-five thousand works in its permanent collection, with assets valued at more than one billion dollars. The collection a museum director dismissed as cellar material is now one of the most important bodies of American art in the world. No market crash destroyed the Whitney money, and no single disaster consumed it. What divided the fortune was Oliver Hazard Payne’s will, one document that punished loyalty and rewarded obedience.
What dissolved the rest was three generations of heirs who believed money was for using. The Whitneys did not hold on to their money, but the thing they built with the part they let go has outlasted every dollar they kept.