He first married Julia Arnold who founded a school. She was the daughter of the academic Tom Arnold. She was a sister of the novelist Mrs Humphry Ward, niece of the poet Matthew Arnold. Their four children included the biologist Julian Huxley (1887–1975) and the writer Aldous Huxley (1894–1963).