The earliest reference to the Stone House by Stone House Brook dates to September 27, 1680, when it was mentioned in the minutes of a Newark town meeting to discuss and distribute land grants. It would have been built sometime after 1660 when the Dutch settled Bergen. A group of Pilgrims settled Newark in 1666 but the English or New England colonial houses of this period were generally built of wood. Dutch colonial houses were usually built of brick, clay, or stone. The original house was one-and-a-half stories with a foundation of native rubble stone. Three of the original walls are still visible from the exterior of the greatly expanded house and a fourth wall is visible from the interior. Nathaniel Wheeler is the first owner, circa 1680, for whom records exist. Dr. Bethuel Pierson, a Revolutionary War patriot and successful mill operator, owned the property 1773-1791 and enlarged it in a similar style using rubble stone. The house was purchased by William Augustus Brewer Jr. in 1866 and occupied by his family 1867-1916. Brewer became President of Washington Life Insurance Company in New York City and was influential in the development of the Village of South Orange as an early President of the Board of Trustees for two terms 1877-1880. Brewer greatly enlarged the house and turned it into a Queen Ann shingle-style mansion. Brewer named the house Aldworth. In 1915, the house was sold to Dr. George C. Albee. The house was sold to the Village of South Orange in 1953 and was used as offices for the school district until 1983. In 1953 the Village of South Orange used the western portion of the property to form the parking lot for the relocated police station. In 1991 the house was added to the New Jersey and National Registers of Historic Places. Also in 1991, much of the remaining land was sold for $1 to the South Mountain B'Nai Brith Federation for development of HUD-approved senior housing. In 2008, stabilization work was done on the Old Stone House. In 2013, the Township of South Orange Village attempted to sell the landmark without success. Preservation New Jersey included it on the list of . The is fund raising to preserve the landmark for cultural and educational uses.
