Wrubel was born to a Jewish family in Middletown, Connecticut, the son of Regina (née Glasscheib) and Isaac Wrubel. His family founded the Wrubels department store in Middletown, Connecticut. He attended Wesleyan University and Columbia University before working in dance bands. "After earning his bachelor’s degree in 1926, Allie enrolled in graduate music studies at Columbia University. He roomed with his close friend, film actor James Cagney [a former Columbia undergrad], and began playing with bands in Greenwich Village and making the rounds on Tin Pan Alley." He played saxophone and clarinet for a variety of famous swing bands. In 1934 he moved to Hollywood to work for Warner Bros. as a contract songwriter. He contributed material to a large number of movies, including those of the famous Busby Berkeley before moving to Disney in 1947.
