Smith originally committed and enrolled at the University of Tennessee, where his father Daryle played. However, after being charged with DUI on campus, he was immediately dismissed by head coachPhillip Fulmer. Smith would then enroll at Marshall University. Smith shared playing time with tight end, Cody Slate, throughout most of his first three seasons at Marshall. As a full-time starter in 2010, Smith finished the year with career highs in receiving yards, receptions, and touchdowns. He also was named to the Conference USA All-Academic team and invited to the Senior Bowl
Professional career
On January 21, 2011, it was announced that Smith had been invited to the 2011 Senior Bowl. Although he was a late invitee, Smith accepted his invitation a week later. He was a part of the Cincinnati Bengals' head coach Marvin Lewis' North team that lost to the South 24–10. Smith was one of 16 tight ends who received an invitation to perform at the NFL Combine. He performed all of the required positional and combine drills and tied Wisconsin'sLance Kendricks for second among tight ends in the bench press. Smith also finished last of the 16 tight ends in the 40-yard dash. On March 17, 2011, Smith opted to participate at Marshall's pro day, along with Martez Wilson, Mario Harvey, and five others. He chose to run his 40-yard dash, 20-yard dash, 10-yard dash, and positional drills for the team representatives and scouts from ten NFL teams. Smith was projected to be a sixth or seventh round by the majority of NFL draft experts and analysts. He was ranked as the tenth best tight end prospect in the draft by NFLDraftScout.com.
The New England Patriots selected Smith in the fifth round of the 2011 NFL Draft. He was the eighth tight end selected in 2011. Smith entered his first training camp facing stiff competition for a roster spot. He competed with Alge Crumpler, Rob Gronkowski, Aaron Hernandez, and Carson Butler. On September 3, 2011, the Patriots released Smith as a part of their final roster cuts.
Buffalo Bills
On September 4, 2011, Smith was claimed off waivers by the Buffalo Bills to provide depth at their thin tight end position.
2011
Upon arriving, he was the Bills' third tight end on their depth chart behind Scott Chandler and Mike Caussin. On October 2, 2011, Smith made his professional regular season debut in the Bills' 23-20 loss at the Cincinnati Bengals. He became the backup tight end after Mike Caussin suffered a knee injury and was placed on injured/reserve on November 7, 2011. During a Week 12 matchup at the New York Jets, Smith made his first career start as the Bills lost 28-24. On December 4, 2011, he caught a season-high three passes for 11-yards during a 23-17 loss to the Tennessee Titans. He entered the game after Scott Chandler injured his ankle and was unable to return. He finished his rookie season with four receptions for 11-yards in three starts and ten games.
On March 10, 2015, Smith signed a three-year contract with the Oakland Raiders. He was placed on injured reserve on October 5, 2016. On March 14, 2018, Smith re-signed with the Raiders. On May 2, 2019, Smith was released by the Raiders.
Buffalo Bills (second stint)
On May 13, 2019, Smith signed a three-year, $9 million contract with the Buffalo Bills.