Cleveland was born into an old-stock American family in Norwich, Connecticut, the son of Margaret and William Cleveland. His maternal grandfather, Richard Falley Jr., fought in the Battle of Bunker Hill. Cleveland's parents reputedly decided at his birth that their son would become a minister. Described as a "thin, pale, and intelligent boy" by Allan Nevins, he worked for periods at an uncle's cotton mill and as a store clerk before winning acceptance into Yale College. He graduated summa cum laude in 1824, and almost immediately moved to Baltimore, Maryland, where he began working as a teacher in a private school. At the same time, he began his advanced theological studies, initially under a local minister and later for a brief period at the Princeton Theological Seminary in New Jersey.
Ministry
On October 18, 1829, Cleveland was ordained as a minister in the Congregational Church. His first appointment led him back to his home state, as the pastor of the First Congregational Church in Windham, Connecticut. His tenure there was not overly successful – the parishioners chided his wife for her colorful clothing and jewelry and were scornful of their decision to bring an African-American woman with them from Maryland as a maid. Cleveland and his family left Connecticut in 1833 and secured an appointment as acting minister of a Presbyterian church inPortsmouth, Virginia. In November 1834, Cleveland moved to a pastorate in Caldwell, New Jersey. The church was remodelled and repaired and added 109 members in around five years. Cleveland then moved to Fayetteville, New York, remaining there until 1850 when he took up a position as district secretary for the American Home Missionary Society. This necessitated a move to Clinton, New York. He enjoyed the position, but the frequent travel over poorly-maintained roads took a toll on his health, aggravating a gastric ulcer that he had developed. Cleveland sought a return to the easier life of a pastor, and in September 1853 found an appointment at a Presbyterian church in Holland Patent, New York. He preached only a single sermon there, dying the following month at the age of 49.
Marriage and family
In Baltimore, Cleveland began courting Ann Neal, the daughter of a well-to-do bookseller. They married on September 10, 1829, and eventually had nine children together, born in several different states. Cleveland had his family live a frugal and inextravagant lifestyle, motivated by religious piety and also by his meager salary. He was a strict Sabbath keeper, requiring his children to devote the entirety of Sundays to worship and prayer. At the time of Cleveland's death, seven children were still living at home. The Holland Patent congregation came to the family's aid by buying the house they lived in, and allowing them to live there free of charge. Cleveland's fifth son, Grover Cleveland, became the 22nd and 24th President of the United States, the only president to serve non-consecutive terms. He was 16 years old at the time of his father's death and reputedly learned of the event from a boy hawking newspapers. Grover Cleveland spoke highly of his father in later life, praising his godliness and devotion to family, and named one of his sons after him. His sister Rose acted as First Lady for the first year or so of his presidency, before his marriage to Frances Folsom.