Elijah spent his early years living with his parents and brothers and sisters in East Runton. After leaving school he took an apprenticeship in the building trade, starting as a bricklayers labourer at Bullens the builders in Cromer.