Lee’s Daughters, Part 3

By David A. Carrino
The Cleveland Civil War Roundtable
Copyright © 2017, All Rights Reserved

Part 3 of a 6-part article about the daughters of Robert E. Lee


Anne Carter Lee

Birth and Childhood

Anne Carter Lee was born on June 15, 1839, the second daughter and fourth child of Robert E. and Mrs. Lee. Annie, as she was called by the members of her family, was named for Robert E. Lee’s mother. In May 1839, the Lee family left St. Louis, which was the location of Lee’s assignment at the time, and traveled to Arlington. Mrs. Lee, who was pregnant with Annie, preferred to give birth there, if only because after the birth of Annie, Mrs. Lee’s parents could help her with the three older children, Custis, Mary, and Rooney. Lee was able to obtain a leave to accompany his family to Arlington, but he soon returned to St. Louis and was not present when Annie was born. He received a letter from his mother-in-law shortly after Annie’s birth, in which he was informed that his second daughter had a prominent reddish birthmark on her face. In his reply, he expressed concern about this and went on to say about the birthmark, “We must endeavor to assist her to veil if not eradicate it by the purity and brightness of her mind.” The method which Lee proposed to deal with the birthmark shows his belief in the power that can be wielded by a vigorous and virtuous intellect. In Lee’s reply to his mother-in-law, he also made a prayer-like statement in which he expressed his hope for the safety of his children. “God grant that they may all be preserved to us.” The way that Lee worded this plea indicates that he wished for his children’s well-being not only for their sake, but also for himself so that he would be able to have them with him for a long time. Lee had no way of knowing that this prayer would not be answered for the latest addition to his family.

Anne Carter (Annie) Lee

In the fall of 1840, the city of St. Louis was satisfied that the harbor improvements that Lee supervised were sufficient, although Lee felt that further improvements were needed. Nevertheless, Lee’s services were deemed no longer necessary, and he returned to Arlington. Shortly before Annie’s second birthday, Lee received a new assignment. By this time, the next member of the Lee family, daughter Agnes, had arrived. Lee’s new assignment was in New York City, and he traveled there alone in the spring of 1841, because Mrs. Lee was still recovering from her latest delivery. Mrs. Lee and the children came to New York a few months later, and the family lived at Fort Hamilton. For Annie, the time at Fort Hamilton was marked by a serious accident that left her sightless in one eye and with a permanent disfigurement. After about a year at Fort Hamilton, Annie, who was three years old at the time, came upon a pair of scissors and pushed the point of the scissors into her eye. In light of Annie’s afflictions, her father felt a special responsibility toward her, and when he wrote his will prior to the Mexican-American War, he saw to it that there was a specific provision for Annie, because he was concerned that Annie “from an accident she has received in one of her eyes may be more in want of aid than the rest.”

Anne Hill Carter Lee
Anne Hill Carter Lee, the second wife of Henry “Light Horse Harry” Lee and the mother of Robert E. Lee, is the person after whom Robert E. Lee’s daughter, Annie, is named.

Annie was self-conscious about her appearance throughout her life, and, perhaps because of this, Annie is the only one of the four Lee daughters for whom no photograph is known to exist. A portrait of a young woman, which was taken from Arlington by a soldier and returned decades later by the soldier’s descendants, was identified as Annie by a former slave. The portrait was painted without the eye disfigurement or the birthmark and is the only known image of Annie. As a girl at Arlington, Annie slept in a four-poster bed that had been owned by George Washington. At first she had her own bedroom, which was next to Mary’s bedroom. Eventually Annie shared her bedroom with her younger sisters, Agnes and Mildred, while Mary continued to have her own bedroom except for those times when Markie Williams stayed at Arlington.

Annie’s Lifelong Companion

One event in the Lee family that greatly affected Annie’s life, although she could not have known it at the time, was the birth of her younger sister, Agnes. Annie and Agnes were the two Lee children who were born closest together temporally, and they were the only consecutively born Lee children who were of the same gender. This led to Annie and Agnes having a very close relationship. In fact, Annie and Agnes had such a close relationship that the family referred to them as “the Girls,” as if they were the only girls in the family. Annie and Agnes were educated together, first by their mother at Arlington beginning in the fall of 1847. At that time Annie was eight years old, Agnes was six years old, and their father was serving in the Mexican-American War. After Lee returned from the war and received his assignment to Baltimore, Annie and Agnes lived there with the family.

When Lee was appointed superintendent of West Point in 1852, Mrs. Lee, Mary, Rooney, Rob, and Mildred lived there with him. Annie and Agnes remained at Arlington and were schooled by a tutor. Several months after Annie and Agnes had been left at Arlington with their tutor and with Mrs. Lee’s parents, Annie received a letter from her father that was dated February 25, 1853. Lee indicated to Annie that he did not have much time to write that letter to her, but that “my limited time does not diminish my affection for you.” Lee continued, “I hope…that you will endeavor to improve and so conduct yourself as to make you happy and me joyful all our lives. Diligent and earnest attention to all your duties can only accomplish this…I do not know what the cadets will say if the Superintendent’s children do not practice what he demands of them.” In that letter, Lee acted toward Annie both as the caring, affectionate father of a 14-year-old daughter and the stern commanding officer of a cadet.

Mary Fitzhugh Custis

During the winter and spring Annie and Agnes began a task that put them on the other side of education. Although Virginia law forbade it, Annie and Agnes were given the responsibility of educating the Arlington slave children, which was a practice for the slave children that their mother and grandmother had consistently adhered to in the past. The spring of 1853 saw Annie and Agnes experience their first real family loss when their grandmother, Mary Fitzhugh Custis, died on April 23, the day after her 65th birthday. According to an account of her death which Agnes, at the age of 12, wrote in her journal, Annie and Agnes witnessed their grandmother’s last breath as she “clasped us in her arms and murmured some affectionate words for her little grandchildren.” As such, Mary Fitzhugh Custis experienced the kind of idealized death that people in the 19th century longed for and that the vast majority of soldiers and sailors in the Civil War were denied. In part because of the death of Mary Fitzhugh Custis, the Lees decided that Annie and Agnes would move to West Point when the family returned there for the next academic year.

At West Point, Annie and Agnes attended the post school. Their older sister, Mary, had attended the post school for a short time the previous year, but transferred to an all-girls school near New York City. Annie and Agnes, who were ages 14 and 12, respectively, when they first arrived at the U.S. Military Academy, did not enjoy life at West Point. The sisters, who were at a typically awkward age, felt ill at ease being surrounded by so many young men, even though one of those young men was their older brother, Custis, who was in his third year at West Point. When the Lees entertained cadets at the superintendent’s house, Annie and Agnes usually left the gathering early. Agnes mentioned the discomfort that she and Annie felt toward the cadets in an entry in her journal a few months after the sisters arrived at West Point. Agnes also wrote about her attempt to deal with this. “To be surrounded by several cadets at once is no very pleasant feeling, but I am overcoming my bashfulness a little.” Annie and Agnes were also dismayed by the harsh treatment given by the older cadets to the incoming ones. Agnes wrote in her journal, “Poor fellows, they are teazed [sic], tormented & tricked almost out of their lives.”

At the end of that academic year, Custis graduated on July 1, 1854, and the family spent the summer at Arlington with G.W.P. Custis, who was trying to adjust to life after the death of his wife. When the family returned to West Point for the following academic year, which was Lee’s third year as superintendent, Annie and Agnes felt more comfortable interacting with the cadets. Near the end of that academic year, in March 1855, Lee was assigned to the Second Cavalry and was to report for duty in Texas. In a letter to a friend, Annie expressed a desire to journey to Texas with her father “to see the beautiful west with its immense prairies, proud mountains, & broad rolling streams.” After the family had packed their belongings, they departed West Point and returned to Arlington. Annie and her sister, Agnes, returned to their Arlington home as maturing young women, who had become more mature than their actual ages due to all of their experiences in the different places where they had recently lived. But in spite of their enjoyment of living in different places, they were very happy to be in the place that to them was home.

Annie’s affection for Arlington is evident in some of her letters. In the summer following Lee’s transfer to Texas, when Annie was 16, she described a morning horseback ride at Arlington in a letter to a friend. In Annie’s words, “You have no idea how beautifully everything looked in the morning dew. Our ride for some distance lay along a row of high hills which commanded a beautiful view of Washington with fields & meadows on one side & dark forests on the other.” In another letter, Annie drew a word picture of a winter sunrise at Arlington with the vivid description, “The Sun is struggling up tinging with gold the heavy clouds which oppose its progress, & throwing its reflection full upon the water beneath, leaving it like a sheet of fire…The mist still hangs over Washington, & the rest of the river, is tossed about by the wind, its waves instead of gently flowing on, as blue as the sky, have a greenish angry appearance & are all crested with foam.” When Annie was 19 and Christmas was approaching, she expressed a desire for an Arlington Christmas like those of her youth, which Annie recalled “used to be so very bright and joyous that we wished Christmas would come all the time…the night before so excited that we could hardly be got to bed.”

The “Awful” Prospect

Flora Cooke Stuart

During the summer of 1855, while Lee was traveling to Texas for his assignment with the Second Cavalry, Lee and Mrs. Lee exchanged correspondence in which they discussed boarding school for Annie and Agnes. As this discussion was taking place, Annie wrote about the impending departure from Arlington in the same letter in which she described the morning horseback ride. She did not seem enthusiastic about attending boarding school when she wrote that during the summer she was having “a delightful time here, except for the prospect of going to school in the fall, awful!” The decision was made to send the sisters to the Virginia Female Institute in Staunton, Virginia. (The Virginia Female Institute currently operates as a pre-K to 12 coeducational school, and the original buildings are still standing. The school is now named Stuart Hall School after Flora Cooke Stuart, the wife of Jeb Stuart. Flora Stuart headed the school from 1880 to 1899 and guided the school through some difficult times, which prompted the school to rename itself in her honor in 1907.)

At the time that Annie and Agnes attended the school, it was run by the Episcopal Diocese of Virginia. According to the school’s 1876 catalog (which is considerably later than the Lee daughters attended the school), students were charged tuition of $40 per year, a fee of $200 for room and board, and an additional fee of $2.50 for pew rental. Living accommodations involved five students sharing one large room in a dormitory. The strong religious underpinning of the school was evident in the first of the “Daily Exercises.” As stipulated in the schedule for the students, “Three quarters of an hour after the rising bell, the Boarders assemble with an Officer, for the silent study of the Scriptures.”

There were stringent rules regarding letters, visitors, and time away. “Parents should specify the epistolary correspondents of the pupils and inform the Principal in general terms as to the visits they may make and the calls they may receive. The calls of gentlemen who may be strangers to the Principal and not specified by the parents are not received by the pupils unless authorized by letters of introduction. From 4 o’clock to 5 P.M., is the most convenient hour for such calls. Pupils will not be allowed to receive calls on the Sabbath unless under very extraordinary circumstances. Pupils will not be allowed, under any circumstances, to spend the night out of the Institute.”

The Virginia Female Institute

Although the strict discipline at the school was beneficial in forcing the students to apply themselves to the taxing curriculum that included algebra, chemistry, botany, theology, geography, and philosophy in addition to New Testament, Latin, French, and piano, it is no surprise that the school’s policy on discipline led to the students calling their school “Staunton Jail.” The school’s faculty also fell victim to the students’ criticism, such as when Agnes recorded in her journal her impressions of some of the faculty. Agnes’ descriptions included the pointed remarks “handsome and attractive but I am still not so perfectly fascinated as most of the girls,” “smart & intelligent, besides very funny—but no beauty,” “a particular little man,” “makes you feel she can be very severe,” “quite strict and rather cold,” and “so odd.” One male teacher was characterized as “the only young man,” but “his looks will prevent our being very desperate.” Like teachers at schools since schools have existed, the teachers at the Virginia Female Institute were targets of sharp criticisms from their students, and the daughters of Robert E. Lee were no different than typical teenaged students with regard to hurling petty criticisms at their teachers.

The two years that Annie and Agnes spent at the Virginia Female Institute were not filled entirely with studying and diligence. One evening in March of their first year, Annie, Agnes, and their roommates engaged in a prank. Perhaps they did this because they were going to be given a test in mathematics a couple of days later and needed to relieve some tension. The girls burned a piece of bristol board and then used the charred material to mark their faces in the pattern of male facial hair. Agnes and one of her roommates were even courageously rebellious enough to go to dinner with the markings still on their faces. But when they were informed that the teacher whom Agnes described as “very severe” was going to be at dinner, the girls quickly wiped their faces clean, or as Agnes wrote in her journal, “caused…my whiskers to vanish.” Agnes ended her journal entry about the prank with the scandalous statement, “The girls were much amused even the dim similitude to a masculine in the V.F.I. [Virginia Female Institute] caused great disturbance.” While the students were amused, the same emotion may not have been felt by the ardently dutiful father who expected disciplined behavior from Annie and Agnes.

Partial list of students at the Virginia Female Institute with the names of Annie and Agnes Lee

During Annie’s first year at boarding school, she wrote a description of herself in a letter, and this description reveals that she was self-conscious about her appearance. Annie considered herself “long and gaunt, sharp as a razor…’nose communing with the skies,’ sharp voice and long fingers, with the sourest expression imaginable.” The previous summer she had described herself in another letter as “quite a spinster sour as vinegar.” Neither of these comments about herself mentions her eye disfigurement or her birthmark, but it is possible that Annie’s opinion of her appearance was influenced by these physical traits.

In spite of her self-consciousness, Annie was studious and reliable, characteristics that she shared with her father, and Annie did well at boarding school, as did Agnes. Lee wrote of his pride in the performance of both of his daughters in their first year at boarding school, although his praise was greater for Annie, and he spoke of Agnes as a parent might speak of the child whose work ethic needs improvement. In a letter to his wife, Lee wrote, “I am very glad to hear that Annie recd so many prizes. I am also very glad to hear of Agnes success. She is less constant than Annie in her application, but I am in hopes will improve with years.” The hopefulness about Agnes that was expressed by the concerned father might have been diminished had he read the worried comment in Agnes’ journal regarding an upcoming exam. Agnes wrote about the exam, “I dread it for I don’t believe I know two questions properly.”

After a summer at Arlington, Annie and Agnes returned for their second year at boarding school. Perhaps because of their good performance the previous year or because of familiarity after their previous time at the school, the sisters were more enthusiastic as they prepared to leave Arlington for their second year of boarding school. Annie’s enthusiasm toward her education was evident in a letter that she wrote near the end of her first year at the school. In that letter, she expressed her excitement about becoming educated in disciplines that were not typical for women of that time. Annie gushed, “What do you think of our studying Geometrie [sic]?” Annie also wrote, with the heady exuberance of a young person anticipating that her generation will correct the flaws that past generations inflicted on the world, “We are going to effect wonders & to raise our sex above the weak trammels of novels and fashions.” Annie’s and Agnes’ education continued to progress during their second year at the Virginia Female Institute, but as their second year at boarding school was ending, and Annie and Agnes were approaching graduation, Annie became so ill that she was sent home to Arlington. Despite missing her sister greatly, Agnes completed the semester and received her diploma. Annie also received a certificate even though she was not able to take final examinations.

“War Is Inevitable”

In the summer following graduation from boarding school, Annie’s health showed only modest improvement from the illness that had come on her while she was at school. Mrs. Lee’s health was also continuing to decline due to her rheumatic disease. In fact, when Annie and Agnes had returned from boarding school the previous summer, Annie wrote to a friend about Mrs. Lee’s poor health when they arrived at Arlington. “Oh! how strange it seemed not to see Ma waiting for us, but she [has] been an invalid upstairs for nearly a month with rheumatism.” Lee, who was still in Texas, urged his wife to go to a hot spring spa. Mrs. Lee agreed, not only for herself, but also in the hope that it would help Annie. Soon after Mrs. Lee and Annie arrived at the spa, Agnes, Custis, and Rooney joined them. Annie’s health improved, but the health of Mrs. Lee did not. While Annie was recovering from her illness, she received a letter from her father in which he wrote, “I wish you to be very good, very wise, very healthy, & very happy.” Lee’s wish for Annie is the kind of hope that a father has for his daughter, but Lee could not have known that in just five years his wish for Annie’s health would come to naught.

Within months after the family’s return to Arlington from the spa, G.W.P. Custis died on October 10, 1857. As executor of his father-in-law’s estate, Lee returned to Arlington from Texas. Lee spent the fall and winter handling those duties as well as tending to Arlington, itself. The following summer Annie still had not fully recovered from the illness that began near the end of her time at boarding school, and Mrs. Lee continued to suffer from her rheumatic disease. Lee decided to bring them to another hot spring spa, and in a letter to a friend, Annie described some of the scenery that she saw during the trip. In that letter Annie wrote that “the mountains, & the little streams…running, gurgling over the stones, the last rays of light as they lit up the clouds & mountains were very beautiful.” The tranquil scene that Annie described was in contrast to the growing secession controversy, which was progressing from an abstract debate to a contentious issue to a grave crisis and eventually to civil war.

The graves of G.W.P. Custis (left) and Mary Fitzhugh Custis (right), which are now within Arlington National cemetery

A little over a year after Annie wrote about the little streams gurgling over the stones and the last rays of sunlight illuminating the clouds, the flames of the crisis that was engulfing the country touched the Lee family when Robert E. Lee, who was still on leave from his duties in Texas due to difficulties with the will of G.W.P. Custis, was sent to lead the military force which put down John Brown’s raid at Harpers Ferry. Another four months passed before Lee returned to Texas. In a letter that Lee sent to Annie shortly after his arrival in Texas, he wrote, “I thought of you, when I got in my blankets & knew you were happy for you were asleep, with Agnes by your side…You must all be happy & agreable [sic] to each other. Youth is so fleeting & life so short.” When Lee wrote those words to his daughter about life being short, Annie had only two and a half more years of her short life left to her.

A few months after Annie received that letter from her father, she entered a summer of great responsibility. Because her mother’s rheumatic afflictions had not improved much at the spas she visited, Mrs. Lee decided to try a spa in Canada. She traveled there with Agnes and with Markie Williams, who was living at Arlington. Annie, who was 21, was left to supervise Arlington’s operations and upkeep. One specific instruction that Annie received from Mrs. Lee in this regard was to carefully monitor the wine cellar, “as the wine there is a tempting article.”

Toward the end of summer Annie also had to handle preparations for her younger sister, Mildred, who was to leave soon for boarding school in Winchester, Virginia. Mildred, who was 14, had been enrolled in the school before her mother left for Canada, and Mrs. Lee and the others were not planning to return to Arlington by the time Mildred left for school. Annie received letters from her mother with instructions for Mildred, such as making sure that Mildred was “reasonable about her clothes,” by which Mrs. Lee presumably meant that Mildred take only as much as necessary and be agreeable to using any clothes that her older sisters no longer needed. The preparations that Annie was making for Mildred also had to be done in compliance with instructions from the boarding school, which stipulated that “each pupil must bring with her a list of her clothing, which must be marked with her name in full; half a dozen towels, also marked; over-shoes and an umbrella.” With all of the duties that had been thrust upon her, the summer of 1860, which was the last summer that Annie spent at Arlington, was most likely arduous and hectic.

With the return of Mrs. Lee and Agnes, the family members who were living at Arlington spent the rest of the year anxiously observing the tumultuous events that culminated with South Carolina’s secession, which itself was the catalyst for the most cataclysmic event in U.S. history. For the Lee family, all these events led eventually to the abandonment of the family’s home, Arlington. This happened after Lee was recalled from Texas, declined the offer to serve with the Union, and decided to fight for the Confederacy. After Lee had gone to Richmond, he foresaw that his family would have to abandon Arlington for their own safety. On April 26, 1861 he wrote in a letter to his wife, “You have to move, & make arrangements to go to some point of safety…War is inevitable & there is no telling when it will burst around you.” Less than a week later, Lee wrote in another letter to Mrs. Lee that she must “prepare all things for removal…When the war commences no place will be exempt.” In this letter, Lee made a comment which contrasted with the many optimistic statements that were being proclaimed at that time about the war being brief. Lee ominously predicted, “The war may last 10 years.” Although Lee considerably overestimated the length of time that the coming war would last, he was correct that it would be a protracted conflict.

War Comes to the Lee Home

Soon after Mrs. Lee received this letter, Orton Williams, Markie’s younger brother, delivered his message about the impending seizure of Arlington by the Union army, and Mrs. Lee then realized that abandoning Arlington was a necessity. During this time, Annie was at White House plantation on the Pamunkey River. When she was informed about the preparations that were being made to flee Arlington, she wrote in a letter to Agnes, “Are you really getting ready to leave?” Mildred, who was still at school in Winchester and evidently did not comprehend the severity of the situation, had written to her mother and complained that she was in need of more clothes. Mrs. Lee, who no doubt was distraught and frantic, gave Mildred a stern reprimand in a letter in which she told her daughter that she was “both hurt & mortified that a daughter of mine at a time when her Father’s life is in peril, her home in danger of being trampled over by a lawless foe should allow a disappointment about a bonnet to be so deep in her mind.” In all likelihood, after Mildred read those harsh words, she had a better understanding of the gravity of the situation at Arlington and of the relative priorities of her garment needs compared to the other issues facing the Lee family.

Markie Williams at the age of 12

At the time that these events were transpiring, Mrs. Lee, Mary, and Agnes were the only members of the family at Arlington. After the family’s belongings were removed or locked in the cellar, the three women fled west, and nine days later Arlington was seized by the Union army. In July Mildred finished her term at school and traveled to be with her family. Because Arlington was in the possession of the Union army, the women of the Lee family were forced to live in various places with family or friends during the first year of the Civil War, most often not all of them together. In mid-July Mrs. Lee received a letter from Markie Williams, who remained loyal to the Union and was given permission to visit Arlington to retrieve her belongings. In her letter Markie wrote, “The poor House looked so desolate…Oh! who in their wildest dreams could have conjectured all this last summer? It was but one year ago that we were all there, so happy & so peaceful.”

Near the end of 1861, Mrs. Lee, Annie, and Agnes were at White House plantation, Mary was in Richmond, Mildred as again at school in Winchester, and Lee was still on his assignment in South Carolina. Lee sent a letter to Annie and Agnes in late November, in which he described the Union occupation of Arlington by saying that the home which “we so loved has been so foully polluted.” In a separate letter to his wife that he sent on Christmas, Lee gloomily, but accurately as it turned out, counseled Mrs. Lee to relinquish any hope of ever recovering Arlington. “As to our old home, if not destroyed, it will be difficult ever to be recognized…It is better to make up our minds to a general loss. They cannot take away the remembrances of the spot, & the memories of those that to us rendered it sacred. That will remain to us as long as life will last.”

In the spring of 1862 Mrs. Lee, Annie, and Mildred were staying at White House plantation. On March 2, 1862 Lee, who was in Savannah, Georgia at the time on his assignment to develop defenses in the southeastern Confederacy, sent a letter to Annie in which he harshly criticized what he perceived to be a serious problem in the Confederate war effort. “Our people have not been earnest enough, have thought too much of themselves & their ease, & instead of turning out to a man, have been content to nurse themselves & their dimes, & leave the protection of themselves & families to others. To satisfy their consciences, they have been clamorous in criticising what others have done, & endeavoured to prove that they ought to do nothing. This is not the way to accomplish our independence.”

A short time later, as George McClellan led the Army of the Potomac up the York-James Peninsula on his drive toward Richmond, Lee, who had returned to the Confederate capital, observed anxiously, since he knew that his wife and two of his daughters were in the path of the Union army. In early April, Lee sent a letter to his wife, in which he gave her what must be considered an obvious warning. “No one can say what place will be perfectly safe or even quiet, but I think a locality within the route of the invading army will be least so.” Mrs. Lee, Annie, and Mildred moved to a house a short distance away from White House, but eventually the tide of McClellan’s advance rolled past the three women, who were caught behind enemy lines. A Union search party was sent to the place where the women were staying, and an officer in that group wrote after the war, “Upon our arrival our reception was not very gracious.” Despite the rough treatment that was doled out by Mrs. Lee, she, Annie, and Mildred were eventually allowed to pass through the lines and go to Richmond. The three Lee women were reunited with their husband and father in mid-June, several days after he was named to command the Army of Northern Virginia and a couple of weeks before the start of the Seven Days Battles.

A sketch of Arlington House done by Markie Williams prior to the Civil War when “peace & love dwelt” there

Near the end of July 1862, Mrs. Lee received a letter from Markie Williams, who had made another trip to Arlington to retrieve some of her belongings. Markie described Arlington with the somber words, “so changed, so changed & yet so like itself…Where once, peace & love dwelt, now, all the insignia of war is arrayed.” Three months after Mrs. Lee received this letter, which had to bring the loss of the family’s home into disheartening clarity, the family endured an even more agonizing loss.

“The Girls” Are Separated

Shortly after Mrs. Lee received the letter from Markie, Annie, Agnes, and Mildred traveled to North Carolina to visit a medicinal spring named Jones Springs. In pre-war summers, the Lee family typically spent some time at mineral springs in Virginia in order to escape the heat. In the summer of 1862, Annie, Agnes, and Mildred went to Jones Springs in North Carolina, because the mineral spring spas in Virginia were too close to the enemy.

They were still in North Carolina in September, and at this time Annie began to suffer headaches and dizziness. In addition, Mildred decided to attend boarding school in Raleigh, because her previous school in Winchester was no longer an option with the war so close by. Because of Annie’s illness, Agnes took charge of helping Mildred make preparations to leave for school. After Mildred’s departure, Annie took a turn for the worse, and by early October she was suffering fever and intestinal discomfort. A physician was called to examine Annie, and a diagnosis of typhoid fever was made. When Mrs. Lee was informed of her daughter’s condition, she managed to travel to Jones Springs to minister to her. At first it appeared that Annie would recover, but several days later Mrs. Lee wrote ominously in a letter to her daughter, Mary, “Annie passed a very uncomfortable night…The Dr. considers her extremely ill.” On the day that Mrs. Lee wrote that letter, Annie suffered greatly, and that night Annie was in great distress. On the following morning, October 20, 1862, Annie Lee died at the age of 23. In a letter to Mildred, Agnes wrote that Annie “breathed her last—very quietly and peacefully,” and Agnes added, “O Mildred, I cannot realize it; it is too strange, too unnatural.”

During the summer after she graduated from the Virginia Female Institute, Annie wrote a sadly prescient statement in a letter to a friend. In that letter Annie wrote, “If we could only realize that only a few short years must pass and then all must leave, how different would be our lives.” Annie was granted far fewer of those “short years” than she could have anticipated. At the time of her death, Annie was almost the same age that her mother was when Mrs. Lee married Robert E. Lee. The day that Annie died was a little more than one month after her father experienced his first major setback as commander of the Army of Northern Virginia at Sharpsburg, Maryland. Less than two months after Annie’s death, Lee won one of his greatest victories in a battle at Fredericksburg, Virginia, which ended the advance of the Army of the Potomac that had led to Annie’s older sister, Mary, being caught behind enemy lines. Annie was buried near Warrenton, North Carolina, although it was Agnes’ preference that her sister be buried in Richmond so that she could more frequently visit the grave of her beloved sister.

Walter Taylor

Mrs. Lee and Agnes returned to Richmond after Annie’s funeral. In a letter that Mrs. Lee sent to her husband, she told him the sad news. Walter Taylor, a member of Lee’s staff, wrote after the war of the day that Lee learned of Annie’s death. According to Taylor, he met with Lee on that day to discuss some “matters of army routine upon which his judgement and action were desired.” These matters were discussed, and, as Taylor recollected, Lee “gave his orders in regard to them. I then left him, but for some cause returned in a few moments, and with my accustomed freedom entered his tent without announcement or ceremony, when I was startled and shocked to see him overcome with grief, an open letter in his hands.” With all three of his sons serving in the Confederate army, Lee no doubt understood that any one of them could be killed. But Lee was very likely not prepared to lose one of his daughters.

Annie’s grave in North Carolina
After her death in 1862, Annie was buried in North Carolina. In 1994 Annie’s remains were reinterred in the Lee family crypt at Washington and Lee University.

Lee wrote to his wife, “I cannot express the anguish I feel at the death of my sweet Annie. To know that I shall never see her again on earth, that her place in our circle, which I always hoped one day to enjoy, is forever vacant, is agonising in the extreme.” Lee continued his letter with an expression of condolence that seemed to be intended to alleviate his family’s sorrow. “But God in this, as in all things, has mingled mercy with the blow, in selecting that one best prepared to leave us.” It is not clear why Lee felt that Annie was the member of his family who was best prepared to die, but perhaps Lee was simply trying to give comfort to himself by putting this sentiment into words. It was Lee’s desire that Annie’s body stay in North Carolina, but in 1994, at the request of descendants of the Lee family, Annie’s remains were moved to the Lee family crypt at Washington and Lee University, where, after more than a century of separation, Annie was reunited with her family.

“We Are Going to Effect Wonders”

In the overall context of history, Annie Lee’s life was unremarkable. Like many children then and now, she spent her childhood being educated and playing with her siblings and friends. As some children are required to do, she moved with her family and lived in different places due to the career of a parent. When she was older, she attended boarding school and did well in her studies. She helped tend to her mother, who was afflicted with progressive rheumatic disease, and she did various household chores. Most of what Annie experienced during her youth is not unusual. When Annie was a young adult, she experienced war firsthand, which is not a widespread personal experience, although this experience was shared by all Americans who lived at the time that Annie lived. Annie died at a young age, and while this was tragic, it was not an uncommon occurrence during the time when she lived. In Annie’s unremarkable and too brief life, she made no significant historical contribution, yet in spite of this she has a place in history. Annie’s qualification for a place in history can be stated similarly to the explanation that was offered for the special treatment that her older sister, Mary, received in Egypt, that is, Annie was the daughter of a particular defeated general. In this respect, Annie has the sad distinction of being the only child of that defeated general to die before he did.

Had Annie lived a long life, as her sister, Mary, did, perhaps Annie could have made a significant contribution to history. A few months before her 17th birthday, Annie exclaimed in a letter to a friend, “We are going to effect wonders,” and in so doing lift women beyond the constraints of 19th century customs. Annie’s premature death put an end to those enthusiastic dreams. But in light of Annie’s statement about raising women “above the weak trammels of novels and fashions,” if Annie had lived long enough, perhaps she would have become involved in the women’s suffrage movement, which was a focal point for women during a time when Annie could still have been alive. Annie’s optimistic statement in that letter suggests that she would not have had the dismissive attitude toward women’s suffrage that Mary expressed in her cynical comment about appearance being as effective for a woman as the vote. Annie’s statement in her letter makes it seem reasonable that Annie would have participated in the women’s suffrage movement, had she lived long enough to do so. After Annie experienced war firsthand, she may have harbored feelings toward war that are similar to those that Mary expressed in 1914 in her prescient comment about the war that was beginning in Europe. Hence, it is not unreasonable to think that Annie might have become part of the women’s peace movement in World War I.

These speculations aside, Annie, like many in the years 1861 to 1865, died far too young and never had the opportunity to even attempt to reach the goals that she set forth earlier in her life, when she was at an age at which the exuberant sunshine of youth illuminated a future in which virtually any accomplishment seemed to her to be within her reach. But even if Annie, with the benefit of a long life, never reached the lofty expectations that she articulated in her letter, if she simply had had the opportunity to live out her post-war life in the peaceful and rewarding obscurity of family, then she would have had the kind of fulfilling life that was the realistic aspiration she likely embraced as a young woman at Arlington. This sort of life, which is not historically noteworthy, is viewed by some, perhaps by many, as mundane and trivial. However, this kind of life was elevated to exalted status by the ancient Greek playwright Euripedes in his play The Bacchae. The final lines of the play state, “Various men outdo each other in wealth, in power, in all sorts of ways. The hopes of countless men are infinite in number. Some make men rich; some come to nothing. So I consider that man blessed who lives a happy life, existing day by day.”

This kind of obscure, blessed, day-to-day life is the life that Annie most likely would have lived had she not died prematurely. This kind of life, which is marked by historically insignificant triumphs and marred by historically insignificant tragedies, seems unimportant. But such a life should not be considered irrelevant. Annie Lee did not have any historically recognizable achievements. Yet Annie, like countless other Americans, deserves a place in history and has a place in history, because Annie Lee was one of the innumerable, seemingly faceless individuals who constitute the indispensable threads in the remarkable fabric of American society and American history.

Go back to Part 2 >>
Continue with Part 4 >>