The history of black people in Manhattan is a story of people getting pushed farther uptown as land acquires new uses and increases in value.