This population-based study reveals that midlife exposure to nitrogen dioxide and particulate matter correlates with poorer cognitive function and adverse brain structural changes in later life, underscoring the neurocognitive risks of air pollution.