Alzheimer's disease (AD) and antecedent factors associated with AD were explored using amyloid imaging and unbiased measures of longitudinal atrophy in combination with reanalysis of previous metabolic and functional studies. In total, data from 764 participants were compared across five in vivo imaging methods. Convergence of effects was seen in posterior cortical regions, including posterior cingulate, retrosplenial, and lateral parietal cortex. These regions were active in default states in young adults and also showed amyloid deposition in older adults with AD. At early stages of AD progression, prominent atrophy and metabolic abnormalities emerged in these posterior cortical regions; atrophy in medial temporal regions was also observed. Event-related functional magnetic resonance imaging studies further revealed that these cortical regions are active during successful memory retrieval in young adults. One possibility is that lifetime cerebral metabolism associated with regionally specific default activity predisposes cortical regions to AD-related changes, including amyloid deposition, metabolic disruption, and atrophy. These cortical regions may be part of a network with the medial temporal lobe whose disruption contributes to memory impairment.