Elmer Albrecht originally composed the song in the early 1920s. At the time, he was a student at the Worsham College of Embalming in Chicago and worked at Louis Cohen’s funeral parlor on Clark Street. According to Albrecht, he originally worked out the tune on a piano in a back room of the funeral parlor which at the time held the corpses of twelve men killed in Chicago’s Tong Wars. Over the years, Albrecht, who continued to work as an embalmer, played the tune inhonky tonks and small night clubs around Chicago. He offered it to Ted Weems, who turned it down. Then, in February 1941, he approached Dick Jurgens, whose band had a residency at Chicago's Aragon Ballroom. Albrecht worked nearby and had an arrangement to use one of the pianos at the venue during his lunch break. Albrecht made a nuisance of himself, and Jurgens, who was inundated with requests from song promoters, finally agreed to arrange Albrecht’s song for his orchestra. A short time later, Jurgens and his band were preparing to perform the tune on the radio. After a frantic effort by the radio announcer and two lyricists to come up with a title, Jurgens casually suggested “Elmer’s Tune” and the name stuck. Jurgens recorded the song as an instrumental for Okeh Records on April 10, 1941. This version reached no.8 on the BillboardBest Selling Retail Records chart in October 1941.
Glenn Miller had the most successful recording of the song. His version reached No. 1 on the Billboard charts. The popularity of the tune prompted Glenn Miller to ask Jurgens if he could record a vocal version of the song. Robbins Music Company, the song’s publisher, hired Sammy Gallop to write the lyrics. Miller recorded his version of the song for RCA Bluebird on August 11, 1941 in New York with Ray Eberle on lead vocals and the Modernaires on backing vocals. This version was an even bigger success than Jurgens’ recording, peaking at no.1 for one week on the Billboard Best Selling Retail Records chart for the week ending December 13, 1941, in a 20-week chart run. The personnel on the recording were Ray Eberle, the Modernaires, Billy May, John Best, Alec Fila, R.D. McMickle, Glenn Miller, Jim Priddy, Paul Tanner, Frank D'Annolfo, Hal McIntyre, Wilbur Schwartz, Tex Beneke, Al Klink, Ernie Caceres, Chummy MacGregor, Bobby Hackett, Edward "Doc" Goldberg, and Maurice Purtill.
