If you want to keep your brain from shrinking as you age, your best way may be to keep your body physically fit. New research from Boston University School of Medicine found that poor physical fitness in midlife was linked to smaller brain size (a sign of accelerated brain aging) 20 years later.  The brain shrinkage is small but significant enough to raise the a person’s risk of getting memory loss and dementia.