In 1858, he married Hattie R. Colahan. In 1864, he moved to New York City. In 1873, he published his best known song, "Silver Threads Among the Gold" (words by Eben E. Rexford), which sold over three million copies. Having sold the rights to it, though, he died penniless in a boarding house in Philadelphia, his last written words: "It’s hard to die alone". His widow died, alone, in 1924. Danks is buried at Kensico Cemetery, in Valhalla, New York.