Mountain began his professional baseball career in July 1880 with the Troy Trojans of the National League. He appeared in only two games for the Trojans and compiled a 1-1 record and 5.29 ERA. In 1881, Mountain played for the Detroit Wolverines of the National League in the club's inaugural season. He appeared in seven games for the team, all complete games, and compiled a 3-4 record and a 5.25 ERA. He pitched and won both games of a double-header for Detroit in 1881. Mountain divided his playing time during the 1882 season between the Worcester Worcesters of the National League and the Philadelphia Athletics of the American Association. He compiled a 4-22 record and a 3.76 ERA with the two clubs in 1882.
Columbus
In 1883, Mountain joined the Columbus Buckeyes of the American Association. He appeared in 128 games, 101 as a pitcher and 29 as an outfielder, for the Buckeyes during the 1883 and 1884 seasons. Mountain appeared in a career high 59 games as pitcher in 1883. He started all 59 games and threw 57 complete games, four shutouts and 503 innings pitched. He compiled a 26-33 record and led the American Association that season in losses, hits allowed, earned runs allowed, and bases on balls allowed. Mountain's best season was 1884 when he won 23 games, lost 17, pitched 40 complete games, and had a 2.45 ERA for Columbus. His ERA was fifth best in the American Association, and his five shutouts placed him fourth. On June 5 of that season he pitched a no-hitter against the Washington Nationals, winning 12–0.
Pittsburgh
After the 1884 season, Mountain, along with the entire Columbus team, was sold to the Pittsburgh Alleghenys. However, an injury prevented Mountain from appearing in more than five games in 1885, and he compiled a 1-4 record and 4.30 ERA. In August 1885, the Alleghenys "indefinitely laid off" Mountain until he could again pitch "in his old form." In November 1885, The Sporting Life noted that Mountain's "disability" was "a terrible disappointment to the club", rendering him unable to bat effectively despite having been a strong batter in 1884. Mountain's batting average dropped from.238 in 1883 to.100 in 1884. One account reported that Mountain's arm was damaged by a "drop ball" pitch which was thrown in a motion bringing the arm above the head and then releasing the ball with a "sharp downward snap of the wrist." Mountain returned to Pittsburgh in 1886. His arm was reported to have recovered, but he injured his ankle in June. He was limited to two games as pitcher and lost both games with a 7.88 ERA. He also appeared in 16 games as a first baseman in 1886 and compiled a.319 on-base percentage in 69 plate appearances. He appeared in his final major league game on August 17, 1886. The following week, a newspaper account reported that his career as pitcher was over, a tryout with Pittsburgh having "proved a jonah."
Toledo
Starting in May 1888, Mountain served as a minor league manager for the Toledo Maumees of the Tri-State League. As manager, he "blacklisted several players, who went on a strike, and there was a popular howl against him." He was released as manager in July 1888.
Career statistics
During his seven seasons in the major leagues, Mountain appeared in 194 games. He started 142 games, threw 141 complete games and nine shutouts, and compiled a 58–83 win-loss record with a 3.47 ERA. As a batter, he compiled a.220 batting average with nine home runs and 84 runs scored.
Family and later years
Mountain was married to Sarah Mountain. They had five children: Martin, Jennie, Rose, Raymond and Hugh. In approximately 1895, Mountain became a clerk for General Electric Company in Schenectady, New York. He worked for General Electric for nearly 40 years, serving for many years as the assistant chief of the factory fire department. He retired in 1931. Mountain died at his home in Schenectady in 1939 at age 79. He was buried at the Most Holy Redeemer Cemetery in Schenectady.