A Pale Horse Named Death was formed in Brooklyn, New York by Sal Abruscato. Critique went with the June release of their album And Hell Will Follow Me. Abruscato's partner on the album is Matt Brown, sound engineer and former guitarist of Seventh Void. "The chemistry between me and Matt is unique and flawless; very rare in today's music. We are the murdering evil version of Lennon and McCartney," says Abruscato. Brown adds, "Sal asked me if I would help to take these songs to the next level. I took on this project for my friend, to find some closure in rough times. The album cover was made by Sam Shearon also known as o'Mister-Sam', who has also done work for Rob Zombie, Fear Factory and Rammstein, and has a 20 page booklet with artwork for each song. Also, the double LP version has a bonus track called "Pickup Truck". Life of Agony's Keith Caputo gave background vocals to four tracks and Lou Reed's saxophonist Ulrich Krieger plays on "Die Alone". Bobby Hambel from the band Biohazard - who has played with the band live at gigs played the guitar leads on three songs. Alongside Abruscato, Brown and Hambel, the live line-up put former Type O Negative and Seventh Void drummer Johnny Kelly on the drums, and Eric Morgan on bass. "This is my pinnacle creation, the best album I have ever done," commented Abruscato. "And after listening, most people are tending to agree." And Hell Will Follow Me was ranked No. 5 album of 2011 by Revolver Magazine.
On January 21, 2013, Lay My Soul to Waste was announced. It was released in North America on May 21, 2013 and in Germany, Switzerland, and Austria on May 23, 2013. Its European release was May 24, 2013. Sal Abruscato talked about the album by saying
''When the World Becomes Undone'' (2017-present)
On December 23, 2017, a new album was announced on the band's Twitter page. On January 29, 2018, it was announced on the band's website that the band had replaced both Matt Brown and Johnny Kelly with Joe Taylor of Lita Ford, Doro Pesch, Corey Glover & Cycle of Pain and Tommy Spano of Corey Glover and Sekond Skyn as new guitarist and drummer for the band. On April 5, 2018, it was announced that the band had signed a new deal with SPV and that the new album would be released on the label's Long Branch Records imprint. It was also revealed that Johnny Kelly has rejoined the band on drums. On October 24, 2018, A Pale Horse Named Death announced that their first album in six years, titled When the World Becomes Undone, would be released on January 18, 2019. On October 11, 2019, the band released a 2-track EP titled Uncovered, featuring a cover of Three Dog Night's "One" and a cover of The Cure's "Prayers For Rain". It was made available as a 7" vinyl and as a digital download limited to 300 physical copies.