Anne Spencer was born Anne Bethel Scales Bannister on February 6, 1882, on a plantation in Henry County, Virginia, to former slaves, Joel Cephus Bannister and Sarah Louise Scales, the daughter of a slaveholder. Spencer’s parents separated in the late 1880s. Her mother supported the family by working as an itinerant cook. Financial hardship led to Spencer being temporarily placed with a foster family in Bramwell, West Virginia, though she was still cared for by her mother, who was determined to raise Spencer as member of the black bourgeoisie.