Seifert was born to a Swiss family and came to London when young. He attended the Central Foundation Boys' School and subsequently obtained a scholarship to the Bartlett School of Architecture, graduating in 1933. Seifert served in the Royal Engineers during World War II.