Most memoir writers will tell you that the hardest part of writing a memoir isn't what to include, but what to leave out.