Lee Hoi-chuen was born in Jun'an, Guangdong on 4 February 1901. He moved to Hong Kong and became a Cantonese Opera actor. There, he met and married Grace Ho (1907–1996) who was of half-Chinese and half-German descent. They had two daughters, Phoebe and Agnes, and three sons, Peter, Bruce and Robert.