Huff joined the United States Army from his birth city of Cleveland, Tennessee, in June 1941, and by February 8, 1944 was serving as a corporal in the 509th Parachute Infantry Battalion. On that day, near Carano, Italy, Huff led a reconnaissance patrol while under heavy fire from German forces. For his actions during the patrol, Huff received the Medal of Honor three months later, on May 26.