“As children we recognized that we belonged to an unusual, even exceptional, family, but the effect was different on each of us.”