Just after midnight on May 5, 1863, on the fields of Virginia north of the Rappahannock River, Joseph Hooker summoned his senior corps commanders to his headquarters and asked a question no commander of a 133,000-man army should have to ask in the middle of a campaign: should they stay and fight, or withdraw across the river? One by one they answered. Howard said fight. Meade said fight.
Reynolds said fight. Sickles said no. Couch said no — and Couch’s reason was not that the army could not win, but that he had lost faith in the man asking the question. Three voices against two in favor of continuing the fight.
Hooker thanked them, then told them he would take the army back across the Rappahannock. That was the entire battle condensed into a single room. The numbers alone make the question remarkable. Lee had roughly 60,000 men in the field.
Hooker commanded an army of about 133,000, a force more than twice the size of Lee’s. Hooker had crossed two rivers unseen, fallen on Lee’s flank and rear, and achieved complete surprise against the most famous general in America. He carried a telegram from Abraham Lincoln in his pocket that said, “This time, send all your men. ” When his own commanders voted to continue the fight, he turned around and went home.
The most famous explanation for this decision is a single sentence attributed to Hooker himself. He supposedly told General Abner Doubleday on the road to Gettysburg, “For the first time, I lost faith in Hooker, and that is all there is to it. ” That sentence appears in nearly every account of the battle. It is almost certainly fabricated.
The phrase did not appear in print until 1910, in John Bigelow’s study of the campaign. Bigelow drew it from a letter written in 1903, forty years after the event, by a former staff officer named E. P. Halstead.
The story the letter tells does not match the record. Hooker was wounded at Chancellorsville and was not with Doubleday two months later. At the time of the alleged conversation, the two men were dozens of miles apart. Doubleday’s own history of the campaign, published in 1882, says nothing about any such confession.
Checked against the records, the rest of Halstead’s letter is a distortion of the facts. The most famous interpretation of Chancellorsville rests on the forty-year-old memory of an elderly man describing a conversation that could not have happened. So what really happened? Something more specific and more interesting.
Joseph Hooker did not lose this battle through collapse. He lost it through a deliberate decision made on May 1, and then by standing on the porch of his headquarters on May 3. The story of where he made that decision, and why the ground he chose made 133,000 men worth no more than 60,000, is the real story of the battle. Hooker was not the fool the legend makes him out to be.
When he took command of the Army of the Potomac in January 1863, the army was in ruin, not from battle alone but from morale. It had just collapsed at Fredericksburg in December in one of the worst-managed attacks of the war. Men were deserting by the thousands. Officers were conspiring against their commander.
Lincoln’s letter handing the army to Hooker is one of the strangest documents any president ever wrote to a general. It acknowledged that Hooker had spoken of the need for a dictator, warned him that only successful generals could set themselves up as dictators, and ended with the words, “Beware of rashness. Beware of rashness, but with energy and sleepless vigilance, go forward and give us victories. ”
What Hooker did that winter was remarkable.
He reformed the food supply, organized pay, established a full sanitary system and a functioning furlough system so soldiers could go home. He gave army units official badges, a simple change that turned anonymous regiments into something men belonged to. He separated the cavalry from its old low-pay duties and made it a single unified corps, which it had never been. And he created an intelligence service.
This part is rarely mentioned in popular accounts, and it matters here. Hooker established the Bureau of Military Information under a New York lawyer named George Sharpe. What Sharpe built was, for its time, a modern apparatus in every sense: scouts inside Confederate lines, prisoner interrogation, signal interception, systematic analysis of Southern newspapers. It was the first organization of its kind in American military history, and it worked.
By the spring of 1863, Hooker did not have a vague sense of Lee’s strength; he had a rough count. He knew he outnumbered Lee by more than two to one. This was not intuition. It was a number.
So he had a general with a reorganized army, twice the enemy’s strength, and the best picture of enemy strength either side had enjoyed in the war. He told people privately that he gave himself eighty chances out of a hundred. He had done his winter work superbly. This is worth stating clearly because the rest of this story will be hard on Hooker.
Historians who have reviewed the records concluded he was not the fool of legend. Frank O’Reilly and Stephen Sears both defended large parts of his conduct. The Joint Committee on the Conduct of the War, which investigated the battle later, did not blame Hooker either; it blamed his subordinates. The committee was not impartial, but the point stands.
This was not a rash man rushing into battle. This was a cautious man who built himself an advantage and then tightened his grip on it. The plan was a double envelopment, and it was brilliant. Hooker would take most of the army, nearly 70,000 men, up the Rappahannock, cross three fords to the north and west, then attack from the left and rear.
Meanwhile Sedgwick would keep about 40,000 men at Fredericksburg, directly in front of Lee, waiting for the right moment to attack. Stoneman’s cavalry would drive deep behind Confederate lines and destroy the railroads that fed Lee’s army. A pincer from both sides, each jaw nearly the size of Lee’s whole force. But Stoneman’s plan failed, and it failed early.
Hooker wanted the raid to begin in mid-April, but heavy rains flooded the rivers, and the cavalry stayed in place for two weeks. When the raid finally launched, it went badly. It was too slow, too cautious, and too easy for the Confederates to avoid. Lee’s supply line survived.
This is one of the great silent failures of the campaign. Hooker built a plan that assumed Lee would be distracted and occupied. That part of the plan did not work, yet Hooker proceeded because the other half was working well. And the other half did work.
On April 27 the army began to move. Three columns crossed the Rappahannock at Kelly’s Ford and the Rapidan at Ely’s and Germanna Fords. There was no resistance worth mentioning. Then they marched east into the tangled region west of Fredericksburg called the Wilderness.
On April 29 and 30 they reached a crossroads where a family named Chancellor ran an inn. Hooker had completely turned Lee’s left flank. Lee did not detect it — not because he was asleep, but because the fords were far enough north, the roads rough enough that movement took time, and because the Army of the Potomac had, for once, not announced its destination. By April 30 Hooker had more than 70,000 men positioned west of Lee, with Lee’s left flank weakly protected.
Hooker issued a statement. He told his army that the enemy must either retreat humiliatingly or come out of his defenses and fight on ground Hooker chose, where certain destruction awaited him. Certain destruction — that was the phrase he chose. Later, according to his chief of staff, Daniel Butterfield, Hooker told his staff something even grander: that his plans were perfect, and that when he began to execute them, God help General Lee, because he would not.
Now look at Lee’s side of the same week. When reports arrived, Lee understood what was coming. Corps of the Union army appeared at Fredericksburg, making noise. He saw that the enemy’s weight was on his western flank.
So he did what the numbers did not suggest: he divided his army. He left about 10,000 men under Jubal Early at Fredericksburg to guard the fords and heights, and moved the rest west to find Hooker. Sixty thousand men splitting in front of 133,000. That is not what the books prescribe.
The Confederate army would do this many times over the next ten days. May 1, 1863, is the day the campaign turned, and it turned in about four hours. Hooker’s advanced divisions moved east out of the Wilderness on the roads toward Fredericksburg. They were executing the plan exactly.
They were seizing open high ground where a 133,000-man army could deploy and fight, and where the road network allowed them to threaten Lee’s rear. They met Confederate forces coming from the west, Anderson’s and McLaws’ divisions under Jackson. A fight developed. Then Joseph Hooker ordered his corps commanders to withdraw to Chancellorsville, into the Wilderness, into the brush, away from the open ground, onto a defensive line.
His own commanders opposed it. Couch argued. Warren, Hancock, and Couch — officers on the ground who could see what was in front of them — told him it was wrong. Some of their units already controlled good positions.
Hooker’s own explanation, given in more than one account, was that he did not want to fight a battle while part of the army was still coming up through the woods, and that he preferred to let Lee attack him from prepared positions on ground he himself had chosen. He said something like, “Lee is not in exactly the position I wanted him. He must fight me on my ground. ”
Read that again, because the sentence sounds strong and is in fact the heart of the problem.
The position Hooker wanted. Hooker had a plan for a battle in the open, where numbers would decide. What he described on May 1 was a battle in the Wilderness, where numbers count for almost nothing. These are not the same ground, and not the same battle.
And here is the most important part, the part that gets ignored. By deciding to stop and let Lee attack him, Hooker gave up the ability to choose the terms. Lee did not have to attack the strong part of Hooker’s line. Lee could go where Hooker was weak.
Taking a defensive position does not mean the enemy will attack you head-on. It means he has the freedom to choose when, where, and how, and you will learn the result later. Hooker made this decision on May 1. Between May 1 and May 6, he made no other decisive decision.
To understand how dangerous this was, you need to know what the Wilderness was. It is not a forest in the usual sense. It is regrown brush, oak and pine, tangled undergrowth so dense that two men twenty yards apart cannot see each other. Locals called it the Wilderness because it was the site of old iron furnaces, where trees had regrown over old workings and slag heaps in a chaos of vines and saplings.
For an army, this terrain does three things. First, it prevents long-range fire. Both rifle and artillery fire depend on seeing the target. In the Wilderness, most fighting happens at shotgun range.
Second, it eliminates artillery. You cannot mass cannons where you cannot see, and you cannot move them where there are no good roads. Hooker had more guns than Lee. On this ground, that advantage was theoretical.
Third, and worst for the Northern army, it eliminates cavalry. Hooker spent the winter building a real cavalry force. In the Wilderness, horses are useless for reconnaissance and almost useless for protection. Hooker entered the battle with a cavalry arm that could not see for him because there was nothing to see through.
Hooker took an army built on numerical superiority, artillery, and a new cavalry force, and placed it in a place where all three advantages disappeared. Now look where Howard’s corps went. Hooker’s line stretched around Chancellorsville in a long arc, its back to the Rappahannock fords, with the Eleventh Corps holding the far end around a place called Dowdall’s Tavern and beyond. The left of this line was on solid ground.
The right end was not a line in any real sense. The Eleventh Corps under Oliver Howard was surrounded by open ground on its right and rear, with nothing covering what came through it. No cavalry cover, no strong skirmish line, no reserve to speak of. In the language of the reports, Howard’s right flank was completely exposed.
Hooker put his army in a single stroke on ground that weakened his strength and left one end hanging in the air. He did not know that yet. He thought he had set a trap. On the night of May 1, in a grove near Chancellorsville, Robert E.
Lee and Stonewall Jackson sat together to decide what to do with the army in front of them. The story of that meeting comes from Jedediah Hotchkiss, Jackson’s mapmaker, who was present and recorded it. The two men used two biscuit boxes as a table. Lee asked Jackson what he intended to do.
Jackson pointed west along the Union line. He proposed to march around it with his whole force. Lee asked what would be left to hold off the enemy. Jackson named two divisions, Anderson’s and McLaws’.
Say 15,000 men, roughly, to stand in front of the main body of the Army of the Potomac. Lee thought about it. He had no reserves, no second line of defense. What he had was the same 60,000 men he had arrived with, divided once to be divided again: half to stop 70,000 while the other half marched around them.
Then he ordered Jackson to go. Two things are worth noting from that tent. First, the arithmetic. Lee was going to hold off Hooker’s main force with about a quarter of his own, in order to attack with the rest.
If either half collapsed, the other was lost. There was no margin of safety in this plan. Every version of it depended on Hooker staying where he was. Second, Lee was betting specifically on Hooker, not on the numbers.
The numbers were disastrous. It was a bet that the man on the other side would keep behaving as he had on May 1 — that he would keep his army in place and allow himself to be outflanked. This was, by any standard, one of the boldest decisions of the war. And it would not have been possible if Hooker had not already given him the first thing he needed: an army that would not move.
May 2 was a Saturday, hot and dry. In the early morning, Jackson’s column began to move. Twenty-eight thousand men, some accounts say more, headed west, then south, then back east again in a long arc around the right end of the Union line. Twelve miles of marching, much of it visible from Federal positions at some point.
Imagine the difficulty of this. A column of 28,000 men, with artillery, wagons, and ambulances, cannot move unnoticed. It stretches for miles. Once confined to a single narrow road, it cannot change direction.
These men were marching across the front of an army more than twice their size, through country where they could have been destroyed if caught in a column on the road. It took all day. At one point Jackson was so far ahead of his rear that he rode back to urge units forward, and the column halted behind him several times. Around noon, Dan Sickles’ Third Corps attacked the rear of the column as it passed near a place called Catherine Furnace.
A sharp fight developed. Sickles took prisoners, among them a full Georgia regiment by some accounts, and it was obvious to him that a large body of Confederate infantry was moving west and south. Now watch what was done with this information. Sickles concluded, based on what he saw and what he knew of the shape of the ground, that Lee was retreating.
This long column was an army pulling back toward Gordonsville. He reported that to his superiors, and Joseph Hooker believed him and acted on it. Hooker sent a circular to his corps commanders ordering them to prepare to advance at dawn and pursue the enemy. He ordered Howard’s Eleventh Corps on the right flank to prepare to move forward.
That same afternoon, in a different tone, Hooker also sent a message to Howard urging him to protect his flank. Reports of this warning arrived through the morning and early afternoon. Howard acknowledged it but took little action. His corps stayed in position, facing south behind low earthworks, with two regiments and a few guns oriented west — toward the direction the Confederates would actually come from.
This is what makes May 2 important. It is not a story of courage or cowardice. It is a story of what a general decides to believe. Hooker, through superior skill, had brought to this battle the best intelligence service in the history of the American army.
On the decisive day, when reports came in, he chose the reading that suited him: the enemy was retreating, not the enemy was flanking me. By noon this choice had a deadline, and the deadline was about five o’clock. Jackson’s men emerged from the woods on the flank of Howard’s corps in the late afternoon. Estimates of the exact time vary.
Reports from men involved range between four and six o’clock. Say five. The fighting began where the Eleventh Corps was facing the wrong direction. There was no real battle, there was a collapse.
Much of the Eleventh Corps disintegrated with astonishing speed. Regiments broke apart and fled west; panic spread. The army’s official records describe men fleeing the field en masse, throwing away their weapons. For the entire campaign, the Union army reported losing about 6,000 men, most of them from Howard’s corps that evening, though not all.
Some units held. A brigade under Adelbert Ames and other officers held a position called Dowdall’s Tavern but was pushed back. Farther east, near a field and farmhouse, a line under Colonel Adolphus Buschbeck, a mixed force of the 73rd Ohio and the 154th New York, held long enough to buy time. But the core of the line fell, and with it the right end of Hooker’s line.
The only thing that prevented the Confederates from driving completely into the rear of the Union army was darkness, and the fact that Jackson’s men were as disorganized by success as the Federals were by panic. The attack stalled in the brush, units intermingled, artillery could not move. Jackson stopped and tried to re-form his lines. Then, near nine o’clock at night, he rode out with a small group to find a way forward and determine exactly where his lines were.
He was on a road between the two armies. In the dark and confusion, North Carolina troops — his own men — opened fire on the riders. Bullets hit Jackson three times. One struck his right hand, two entered his left arm, one below the elbow and one above, breaking the bone.
They had to lift him off his horse and carry him from the field. That night, in a field hospital, his left arm was amputated. He died on May 10 of pneumonia. When Lee heard the news, he said a phrase repeated so often it has nearly lost its meaning: “He has lost his left arm, but I have lost my right.
” It was not merely a figure of speech. Lee had just fought the biggest and boldest battle of his career. In it he used Jackson as a weapon that had never failed him. The bill for Chancellorsville was presented almost immediately.
Lee’s greatest gamble had succeeded by nine o’clock on the evening of May 2 — and at almost the same moment, he lost Jackson, his finest fighter. These two facts are one fact, and the rest of the war turns on it. May 3 was the bloodiest day of the battle and the day the outcome was decided. It was also a day in which the commander of the Army of the Potomac barely ran the battle during its decisive hours.
Start with the morning. The Confederates wanted control of the heights at Hazel Grove, a field on the Union line with open views in all directions. It is exactly the kind of position artillery dreams of in a battle where no one can see. Hooker ordered Sickles to withdraw from Hazel Grove.
This decision deserves its own sentence because it is the second greatest gift of this battle. Look at the map as an artillery officer looks at it. Hazel Grove is the only place on the field from which you can see anything, and Hooker gave it away. Confederate artillery moved up in the morning and began shelling the Union lines from ranges they could not have reached otherwise.
The clearing that covered Hooker’s entire position became the target of their guns. Around nine in the morning, Hooker was standing on the porch of the Chancellor house with one of his aides, leaning against a wooden column. A solid Confederate shell struck the column, and it broke apart. Hooker fell to the ground, stunned.
He was not killed, not seriously wounded, but the effects were clear, and the physical evidence here is exceptionally good because the injury was witnessed by the army’s medical director, Jonathan Letterman, standing only a few yards away, as well as Hooker’s own aides. One aide wrote that the blow seemed to knock the general unconscious. Then it got worse. Later that day, Hooker was lying on a blanket or camp bed not far away when a second shell fell, reportedly striking the blanket itself.
From about nine in the morning until late afternoon, Hooker issued almost no orders. This is not interpretation; it is Couch’s testimony. Couch, the Second Corps commander and Hooker’s second-in-command, said afterward that after the shell struck, Hooker gave no significant direction for hours, and that the fighting was conducted by each division commander doing what he thought right for the situation before him. At one point Hooker summoned Couch and told him what amounts to a surrender of the army: “Take command and execute it as the map directs.
” Couch went to do it. Then Hooker recovered himself and resumed command. Imagine the morning of May 3, then: a concussed, dazed general ordering the abandonment of the only significant high ground on the field, on the day the enemy would attack with everything he had left. Yet command of the army stayed in his hands.
The fighting that day was some of the worst of the war. Nearly 18,000 men fell, killed or wounded, in a single day, from both armies. Lee’s army, with Jeb Stuart commanding Jackson’s corps, drove Hooker completely off the crossroads. The Chancellor house, a brick tavern dating to 1816, burned, with the family still hiding in its cellar.
By noon Hooker’s lines had been reduced to a smaller perimeter covering the last open road to the river. Meanwhile, at Fredericksburg, the nearly 40,000 Union soldiers who had not yet played much part in the main battle finally moved. On May 3 Sedgwick’s corps attacked and took Marye’s Heights — the same heights where Burnside’s army had been shattered in December. It was a great achievement.
But Sedgwick pushed west and ran into a quickly formed Confederate line under McLaws and Early, using troops Lee had pulled from the Chancellorsville front and sent east on forced marches. Sedgwick’s attack stalled at Salem Church on May 3 and fell back on May 4. His corps recrossed the river at Banks’ Ford, having lost between 4,500 and 5,000 men, and achieved what Hooker’s arrangements allowed, which was nothing. At one moment on May 3, Sedgwick’s men were on the heights while Hooker’s men still held the line, and Lee was caught between them.
That was the maneuver the plan had been built for. It lasted a few hours and came to nothing because Hooker did not advance. Then it rained, and the river began to rise. This brings us back to the tent at midnight.
By the night of May 4 and into May 5, Hooker’s bridges over the Rappahannock were threatened by rising water. There was still a large army south of the river. Hooker called his commanders and asked, shall we attack? Howard said yes, Meade said yes, Reynolds said yes, Sickles said no, and Couch said no.
Couch’s objection is the most damning in this account. He was not sure the army could win, but he was sure the commander could not win. The majority voted to continue the fight. Hooker told them he would take responsibility for withdrawing the army.
During the night of May 5 and into the morning of May 6, the Army of the Potomac crossed the Rappahannock and returned to the north bank. Now the facts. Union casualties in this campaign were about 17,000. Confederate casualties about 13,000.
Estimates vary slightly among historians. Sears gives roughly 17,300 and 13,400. Eicher gives roughly 17,200 and 12,800. But the order is consistent.
The losing army lost more men, which is normal. What is abnormal is the proportion each side lost. Lee lost about 13,000 men — an enormous percentage of the force he actually committed. He fought with about 52,000 infantry and lost nearly a quarter of them.
The Army of the Potomac lost about 17,000 from an army more than twice that size. The same battle, the same week, two entirely different stories. And here is the number that should be engraved on the wall at Chancellorsville: by some estimates, of the roughly 133,000 men present, only about 40,000 fired a shot. Read that again, because it is the real answer to the riddle.
The Army of the Potomac was not defeated at Chancellorsville because Lee somehow outgeneraled 133,000 men. It was defeated because a large part of that numerical superiority was never brought to bear at the decisive time and place, while the part that was used went into battle piecemeal, with no cavalry to protect it, no artillery advantage to exploit, and a commanding general who provided little direction during some of the most critical hours. Hooker’s army was not defeated. Hooker’s army defeated itself.
Now the consequences. The first cost was Jackson. Lee lost the only subordinate capable of carrying out the kind of operation Lee wanted to fight: the fast, bold, independent stroke. He would spend the rest of the war looking for a replacement and never find one.
The second cost was the recorded bill: 13,000 men from a Confederacy whose military-age population was shrinking monthly, with no immigration to draw on. The South could not afford this kind of victory except at an unpayable price. Every one of those 13,000 Chancellorsville soldiers had to be paid from a fixed account. The third cost came two months later in Pennsylvania, because Chancellorsville solved none of Lee’s major problems.
Virginia was exhausted. His army needed food, forage, horses, and room to maneuver. Lee believed that another campaign on Northern soil might change the strategic equation of the war. Within weeks, the Army of Northern Virginia was marching toward Pennsylvania.
Why Lee took that gamble and what he hoped to achieve before anyone heard of Gettysburg is the next story. One thing from this campaign deserves a final look. It is a single sheet of paper, still catalogued. It is a circular letter on Army of the Potomac headquarters letterhead, 4.
5 by 7 inches. It bears the time, 6:30 a. m. , May 6, 1863 — the morning Hooker’s army finished crossing back over the Rappahannock.
Dictated to an aide named William H. Lawrence and signed by Chief of Staff Butterfield, it says: “The Commanding General will be at the old camp near Falmouth tonight. ” The old camp. The same ground the army had left a week and a half earlier in the opposite direction, carrying the proclamation in its pocket.
Now compare that letter to the other document, issued April 30, which said the enemy must either retreat humiliatingly or come out and be destroyed on ground Hooker chose, where certain destruction awaited. Six days separate them. The same command, the same order book. This is the core of the matter, and it is why the story of Hooker collapsing never convinced anyone.
The story of courage is a story of a man. What happened here is a story of a decision. On May 1, Joseph Hooker led the largest, best-equipped, best-informed army in the history of the United States, with more than twice the enemy’s strength and the only effective intelligence service in North America, and moved it from ground where those factors were decisive to ground where they were not. Then he waited for the enemy’s reaction.
Robert E. Lee did not wait. He divided his army twice in front of a force more than double his size, sent 28,000 men twelve miles around an exposed flank, seized the high ground that was handed to him, and paid for it with a quarter of his fighting strength. Because Chancellorsville solved none of Lee’s major problems, Virginia was exhausted, and his army needed food, forage, horses, and room to maneuver, Lee believed that another campaign on Northern soil might change the strategic equation of the war.
Within weeks, the Army of Northern Virginia was marching toward Pennsylvania. Why Lee took that gamble and what he hoped to achieve before anyone heard of Gettysburg is the next story.