McFadden was born on July 29, 1937 in Raleigh, North Carolina. He attended the University of Minnesota, where he received a B.S. in Physics, and a Ph.D. in Behavioral Science (Economics) five years later (1962). While at the University of Minnesota, his graduate advisor was Leonid Hurwicz, who was awarded the Economics Nobel Prize in 2007.