Pryce was in the Welsh-language band :cy:U Thant |U Thant with his brother Iwan Pryce, Huw Bunford, Owen Powell and others in a changing line-up, from 1989 to 1993. He recorded with Catatonia on their first two EPs before Super Furry Animals formed in 1993. Working with dub and reggae label Trojan Records, Pryce put together a compilation Furry Selection: Luxury Cuts Of Trojan Chosen by a Super Furry Animal in 2007. Pryce recorded The Golden Mile with The Peth in 2008, a group which features Welsh actor Rhys Ifans on vocals, Super Furry Animals bandmate Dafydd Ieuan, Meilyr Gwynedd, Osian Gwynedd, Mick Hilton, Dic Ben and Kris Jenkins. In 2010 Pryce played bass for Spectrum on their US and European tours. Under the band name The Stand, Pryce joined Welsh actor Jonny Owen, Owen Powell, and Ryan Richards of Funeral for a Friend to record a fundraising single "I'll Be There" in 2010. Proceeds from sales went to a fund to erect a statue of the footballer Fred Keenor on the Cardiff City F.C. grounds. The song was adapted from the original written during the coal miner's General Strike of 1926 and often sung by Cardiff City fans. Pryce had previously shown his support for the team when the Super Furry Animals signed on as sponsors in 1999, with the band's name displayed on team jerseys. In 2012, Pryce began performing with his partner, Scottish singer and keyboardist Lindsey Leven, under the name Gulp. The band includes Gid Goundrey on guitar, Gwion Llewelyn on drums, with contributions from Gareth Bonello on acoustic guitar and cello. Gulp has performed around the UK, Europe and United States and done several UK radio sessions – including for BBC Radio Wales and Sŵn Radio. They have released the single '"Play'", and track '"Game Love" on the compilation and cover of Django Django's "Hand of Man" on their Late Night Tales compilation. Gulp's debut albumSeason Sun was released in July 2014 on Everloving Records in the US and on Sonic Cathedral in the UK. Pryce was part of a rare 2012 concert appearance by English singer-songwriter Mark Fry, honouring Fry's 1972 album Dreaming with Alice, along with Nick Franglen of Lemon Jelly, Nick Palmer of The A. Lords, Grasshopper of Mercury Rev and Martin Smith of Tunng. In 2012, Pryce led music workshops for youth at the charity Grassroots Cardiff Ltd. At Focus Wales 2013, Pryce was a panelist for the Welsh Music Foundation. Pryce and Leven currently live in Dundee, after years in Cardiff. Their son Elis was born in 2018.